Forrester Realistic Load Testing
-
Upload
compuware-apm -
Category
Technology
-
view
1.383 -
download
1
description
Transcript of Forrester Realistic Load Testing
![Page 1: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/1.jpg)
![Page 2: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/2.jpg)
Perform Realistic Web Testing To Ensure Blazing Fast Web Site PerformanceMike Gualtieri
Senior Analyst
Forrester Research
James Staten
Principal Analyst
Forrester Research
June 16, 2009
![Page 3: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/3.jpg)
Realistic Web performance testing is
critical to achieving flawless user experiences.
![Page 4: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/4.jpg)
4Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Agenda
• Why your customers won’t wait
• What is realistic performance testing?
• Recommendations
![Page 5: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/5.jpg)
5Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Agenda
• Why your customers won’t wait
• What is realistic performance testing?
• Recommendations
![Page 6: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/6.jpg)
6Entire contents © 2008 Forrester Research, Inc. All rights reserved.
• Raw page load speed Gomez Media Home Page BenchmarkApril 10 ’09 – May 10 ’09
0:00 - 24:00 EST
Performance means:
![Page 7: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/7.jpg)
7Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Gomez Media Article Search Transaction
BenchmarkApril 10 ’09 – May 10 ’09
0:00 - 24:00 EST
• Customer workflow speed
Performance means:
1
2
3
![Page 8: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/8.jpg)
Blazing fastWeb sites = customers
![Page 9: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/9.jpg)
9Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Traditional Web performance testing doesn’t cut it• Traditional testing is expensive.
• Cost of licenses, hardware, and training
• Time-consuming to implement
• Idiosyncrasies of the software are often difficult to master.
• Traditional testing is not realistic.
• Scope is limited to internal, clean-room testing.
• Not focused on end-user point of view
• Misses too many pieces in the Web application delivery chain such as content delivery network (CDN), third-party components, geography, etc.
![Page 10: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/10.jpg)
10Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Most developers are building Web apps“What types of new custom applications are your firm’s developers building?”
(Multiple responses accepted)
Base: 977 platform software decision-makers at North American and European enterprises and SMBsSource: Enterprise And SMB Software Survey, North America And Europe, Q4 2008
![Page 11: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/11.jpg)
11Entire contents © 2008 Forrester Research, Inc. All rights reserved.
New trends make optimal user experiences even more important• The Millennial generation expects more.
– 18- to 27-year-olds
– The tech-savvy generation
• Web site redesigns
– Rich internet applications (RIA)
• More Web sites are composed of third-party components.
• Virtualization of infrastructure, including cloud
• Mobile apps availability is exploding.
![Page 12: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/12.jpg)
12Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Agenda
• Why your customers won’t wait?
• What is realistic performance testing?
• Recommendations
![Page 13: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/13.jpg)
Realistic testing means taking a walk in your customers’ shoes.
![Page 14: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/14.jpg)
14Entire contents © 2008 Forrester Research, Inc. All rights reserved.
“Realistic testing” means testing from your customers’ point of view• Where do they access your site from?
– Bangkok, Cannes, Des Moines, Dubrovnik, Edmonton, LA, London, Miami, Osaka, Pusan
• What do they do?
– Key tasks, transactions, and business processes
• How do they do it?
– Browsers galore, mobile devices
• When do they do it (and how frequently)?
– Peak times, spikes
![Page 15: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/15.jpg)
15Entire contents © 2008 Forrester Research, Inc. All rights reserved.
The user’s distance from the content matters
Source: Tom Leighton, “Improving Performance on the Internet,” Queue, October 2008
![Page 16: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/16.jpg)
16Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Boston users of forrester.com have the fastest response time
Source: Gomez (www.gomez.com)
![Page 17: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/17.jpg)
17Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Browsers render differently
Source: Gomez (http://www.gomez.com)
![Page 18: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/18.jpg)
18Entire contents © 2008 Forrester Research, Inc. All rights reserved.
What features should a realistic Web performance testing platform have?
It should:
• Test from the end user’s point of view.
– Different locations
– Different browsers
– Different loads
– Different tasks
• Be easy for developers, testers, and businesspeople to use.
• Identify and resolve problems along the entire Web application delivery chain.
![Page 19: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/19.jpg)
19Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Web sites are increasingly held hostage by third-party apps
Source: Gomez (www.gomez.com)
![Page 20: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/20.jpg)
20Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Vendors offering performance measurement solutions
• Gomez
• Keynote Systems
• Cordiant Technologies
![Page 21: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/21.jpg)
21Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Agenda
• What do customers want?
• What is realistic performance testing?
• Recommendations
![Page 22: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/22.jpg)
22Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Recommendations• Design a test plan based on how real users interact with your Web application.
• Use testing tools that allow you to test from your user’s point of view:
– Where, what, how, and when
• Test the entire Web application.
• Democratize testing:
– Build a test team that includes anyone who has a stake in the outcome.
![Page 23: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/23.jpg)
23Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Recommendations (cont.)• Test early to nip problems in the bud.
• Test often to maintain a consistently supreme user experience.
• Follow the “Blazing Fast Web Site Performance” best practices to keep your Web site humming.
![Page 24: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/24.jpg)
Don’t leave user experience to chance.
![Page 25: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/25.jpg)
25Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Perform realistic Web testing to achieve blazing fast Web
site performance.
![Page 26: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/26.jpg)
26Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Thank you
Mike Gualtieri
+1 617.613.6145
James Staten
+1 650.380.3733
www.forrester.com
![Page 27: Forrester Realistic Load Testing](https://reader034.fdocuments.in/reader034/viewer/2022052321/554c9b1eb4c905f0178b4c87/html5/thumbnails/27.jpg)
27Entire contents © 2008 Forrester Research, Inc. All rights reserved.
Selected Forrester research
• February 4, 2009, “Best Practices: Attaining And Maintaining Blazing Fast Web Site Performance”
• February 4, 2009, “Case Study: How Orbitz Takes You Places Faster”
• August 15, 2008, “Best Practices: Blazing Fast Web Site Infrastructure”
• August 15, 2008, “Case Study: How Msnbc.com Is First In News”