Windows 8 and 8.1 Forums

Internet Explorer Performance Lab: reliably measuring browser performa

  1. #1

    Internet Explorer Performance Lab: reliably measuring browser performa

    In this post we take a look at something we all care very deeply about--as engineers and as end-users--real world web performance. We do a huge amount of work to get beyond the basics of anecdotes and feel as we work to build high performance web browsing. This post is authored by Matt Kotsenas, Jatinder Mann, and Jason Weber on the IE team, though performance is something that every single member of the team works on. --Steven

    Web performance matters to everyone, and one engineering objective for Internet Explorer is to be the world’s fastest browser. To achieve this goal we need to reliably measure browser performance against the real world scenarios that matter to our customers. Over the last five years we designed and built the Internet Explorer Performance Lab, one of the world’s most sophisticated web performance measurement systems.

    The IE Performance Lab collects reliable, accurate, and actionable data to inform decisions throughout the development cycle. We measure the performance of Internet Explorer 200 times daily, collecting over 5.7 million measurements and 480GB of runtime data each day. We understand the impact of every change to the product and ensure that Internet Explorer only gets faster. This blog post takes a deep look at how the IE Performance Lab is designed and how we use the lab to ensure we’re continually making the web faster.

    In this post, we present:

    Overview of the IE Performance Lab
    Lab infrastructure
    What (and how) we measure
    Testing a scenario
    Results investigation
    Testing third-party software
    Building a fast browser for users

    Overview of the IE Performance Lab

    In order to reliably measure web performance over time, a system needs to be able to reproducibly simulate real world user scenarios. In essence, our system needs to create a “mini version of the Internet.”

    The IE Performance Lab is a private network completely sealed from both the public Internet and the Microsoft intranet network, and contains over 140 machines. The lab contains the key pieces of the real Internet, including web servers, DNS servers, routers, and network emulators, which simulate different customer connectivity scenarios.

    Although this may appear complex at first glance, this approach allows all sources of variance to be removed. By controlling every aspect of the network, down to individual packet hops and latencies, our tests become deterministic and repeatable, which is critical to making the results actionable. In the IE Performance Lab, activity is measured with 100 nanosecond resolution.
    Click image for larger version
    Diagram shows content servers connected to Network emulators, connected to DNS servers, connected to Test clients, connected to Raw data storage, connected to Data analysis, connected to SQL database.

    This type of network configuration also provides a great amount of flexibility. Because we’re simulating a real world setup, our lab can accommodate nearly any type of test machine or website content. The IE Performance Lab supports desktops, laptops, netbooks, and tablets with x86, x64, and ARM processors, all simultaneously. Similarly, because the lab uses the Windows Performance Tools (WPT), we can run the same tests using different web browsers, toolbars, anti-virus products, or other third-party software and directly compare the results.

    WPT provides deep insight into the underlying hardware. Using WPT, we can capture everything from high-level CPU and GPU activity, to low-level information such as cache efficiency, networking statistics, memory usage patterns, and more. WPT allows us to measure and optimize performance across the stack to ensure that the hardware, device drivers, Windows operating system, and Internet Explorer are all efficiently optimized together.

    A single test run takes 6 hours to complete and generates over 22GB of data during that time. This highly automated system is staffed by a small team that monitors operations, analyzes results, and develops new infrastructure features.
    Lab infrastructure

    The Performance Lab infrastructure can be broken into three main categories: Network and Server, Test Clients, and Analysis and Reporting. Each category is designed to minimize interaction across components, both to improve scalability of testing and to reduce the possibility of introducing noise into the lab environment.
    Click image for larger version
    A large room full of computers

    Here’s a view of the IE Performance Lab, including a number of test and analysis machines on our private network.

      My System SpecsSystem Spec

  2. #2

    Bay Area
    Posts : 21,837
    Windows 7 Home Premium x64

    Interesting, thanks

    A Guy
      My System SpecsSystem Spec

  3. #3

    And the results are?????????
      My System SpecsSystem Spec

  4. #4

    Posts : 5,707
    Windows 8.1 Pro

    Quote Originally Posted by boastree View Post
    and the results are?????????
    ie 10! :d
      My System SpecsSystem Spec

Internet Explorer Performance Lab: reliably measuring browser performa
Related Threads
How to Open and Use Performance Dashboard in Internet Explorer 11 The Performance dashboard in Internet Explorer 11 (IE11) is a tool that quickly gives you the time it takes a webpage to render changes that were made to the DOM (Paint Time), how many frames per second it's rendering (Frame...
According to new data from NetApplications, Microsoft's Internet Explorer 10 browser holds a 19.45% market share and is currently in second place behind Internet Explorer 8. Internet Explorer 10, which has already surpassed Google Chrome and Mozilla Firefox in terms of market share, is close to...
Hey guys I'm new here, so I apologize if this has been asked before. I have a Lenovo IdeaPad Yoga with Windows 8, and I decided to unpin the internet browser app because I was more used to browsing while in desktop mode. Now that I use my ultrabook as a pad more often, I feel like it would be...
5242According to some info from, Microsoft's Internet Explorer regained some of the browser usage. To be more specific, IE managed to rise it's market share by 1% in March. That's quite a lot. On the other hand, the top four rivals dropped. (Firefox, Chrome, Safari, Opera) Statistics...
Eight Forums Android App Eight Forums IOS App Follow us on Facebook