New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the...
-
Upload
correlsense -
Category
Technology
-
view
1.664 -
download
0
description
Transcript of New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the...
![Page 1: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/1.jpg)
New Approaches to Real-Time Application Testing and Performance Monitoring
December 15, 2011
![Page 2: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/2.jpg)
Agenda
• Best practices for holiday performance testing• New testing and monitoring techniques• Demo• Q&A
![Page 3: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/3.jpg)
Housekeeping
• Presentation will last 45 minutes• Submit questions via the chat window• Slides will be made available
![Page 4: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/4.jpg)
Featured Speakers
Oren EliasCEOCorrelsense
Dan BartowVP, Chief EvangelistSOASTA
Brad JohnsonVP, Product MarketingSOASTA
![Page 5: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/5.jpg)
BEFORE, DURING AND AFTER THE HOLIDAYS
![Page 6: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/6.jpg)
The Online Market
You are here!
![Page 7: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/7.jpg)
Cyber Monday 2011
• $1.3B • 33% y/y growth in traffic• 10.8% is Mobile (3.9% last year)
![Page 8: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/8.jpg)
iCommerce: Biggest Mobile Influence
![Page 9: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/9.jpg)
The IT Landscape Has Changed
What is “Peak Load”?• 100%, 200%...500%+?• How much mobile traffic should we prepare for…and how?
What Are The Most Important Transactions?• What are the most profitable paths users follow?• What is the affect of non-buying “browsing” on paying customers?
What System Do You Test In?• Is the lab good enough?• Production testing is taboo (isn’t it)?
How Will You Find The Issues?• Complexity reigns • How do we see where issues are at load?
![Page 10: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/10.jpg)
The IT Landscape Has Changed
What is “Peak Load”?• You must to test to new limits with a mix of web and mobile traffic
What Are The Most Important Transactions?• Those that you determine as profitable, complex and/or risky
What System Do You Test In?• Testing is a continuous process from the lab to live production
How Will You Find The Issues?• Monitoring during tests for the the end-to-end view while tests run
![Page 11: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/11.jpg)
BEST PRACTICES
![Page 12: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/12.jpg)
Monitoring best practice 1“Assume Nothing”
Oops. A production server!
UAT Environment topology autodetected
![Page 13: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/13.jpg)
Monitoring best practice 2Visibility explains REAL phenomenas
Specific transaction type is failing
Specific location is failing
![Page 14: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/14.jpg)
Monitoring best practice 2Visibility explains REAL phenomenas
When compared to % Time spent within the Data Center
Or the %Time spent rendering on the user’s device
You can see that the % Time spent between User and Data Center is the issue here
It is pretty easy to see the load balance mismatch
![Page 15: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/15.jpg)
Monitoring best practice 3Baseline and compare
Compare application model of 100% load vs. 150% of load
![Page 16: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/16.jpg)
Testing best practice 1
• Start early & test progressively.– Begin in development
– Run many iterative tests that address performance from code though infrastructure
– Finish in production (Live prod to really be sure)
![Page 17: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/17.jpg)
Testing best practice 2
• Test realistically.– Model users acting like humans
– Stress & measure at a realistic pace
– Run at true scale
– From different locations and devices
![Page 18: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/18.jpg)
Testing best practice 3
• Seek a single source of performance truth.– Get Dev & Ops on the same page. (Is 2 seconds okay?)
– Measure with the same tools in Dev, Test & Ops
– Correlate monitoring data with test data as tests run
![Page 19: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/19.jpg)
Thankfully, There is a Solution
SharePath identifies critical transactions to test what matters most
CloudTest enables testing to any level with web or mobile traffic – in lab or production environments
Monitor critical metrics during and after tests to isolate and prevent production outages
![Page 20: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/20.jpg)
Demo
![Page 21: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/21.jpg)
Summary
• The IT Landscape has changed • Start your testing early, test progressively, and
test realistically• When monitoring critical applications, assume
nothing, look for root cause phenomena, use baselines, and compare
• SharePath and CloudTest provide an integrated solution
![Page 22: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.fdocuments.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/22.jpg)
Questions
Get your free copy SharePath RUM!
http://www.real-user-monitoring.com/
Contact SOASTA:www.soasta.com/cloudtest/[email protected] us:
twitter.com/cloudtest
facebook.com/cloudtest
Contact Correlsense:www.correlsense.com/[email protected] us:
twitter.com/correlsense
facebook.com/correlsense
Download CloudTest Lite - FREE!
www.soasta.com/cloudtest/lite/
GET STARTED TODAY!