Post on 09-May-2015
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Load Testing Mobile Sites and Apps Made Easy(using open source compatible and
cloud based solutions)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
BlazeMeterOphir Prusak Customer Satisfaction & Education
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Today’s Agenda
• The Current State of Affairs
• Challenges and the Importance of a Fast Mobile Experience
• Mobile Testing Solution Walkthrough
• Q&A
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Current State of Affairs
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Current State of Affairs
Internet Searches
mobile applicationdevelopment
mobile application testing
mobile performance testing
mobile application performance testing
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
mobile performance testing
Current State of Affairs
Internet Searches
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Mobile Challenges
Desktop Mobile
Client “Standard” Browser Multitude of clients
Technology HTML HTML / Native
Bandwidth Fast (1-20 Mb/s) Slow (0.1 Mb/s and up)
Latency Small (less than 100ms) Large (100-1000ms)
Visual Feedback Immediate After data has loaded*
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Network Challenges
Latency effect on page load times
Source: http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Development Life Cycle
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Development Life Cycle
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Performance Testing Solution Walkthrough
Load Testing Steps• Record the mobile user scenario• Configure test parameters• Run load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Recording a Mobile User
Simulation Techniques• Browser Spoofing- Over-ride user-agent string- Only applicable for mobile websites- Does not simulate mobile hardware or functionality
• Proxy Recording- Works with almost all mobile apps - Requires setting up mobile device to use a proxy
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Setup the Proxy
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Get Your Local IP
Local IP address on a Mac
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Point Device to the Proxy
Defining proxy settings on an iPhone
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Run the App
Real usage of a mobile app (CNN iPhone app)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
View Requests in JMeterAll of the requests made by the app.
Request Headers
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Full Recording of All Data
DifferentUser Agent
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Load Testing Steps
• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Define Test Parameters
- Number of Users - Number of Servers- Test Duration- Ramp Up Time- Load Server Geo Location- Custom DNS- Private IPs- Aggregation of Multiple Tests
Run in Parallel
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Mobile Network Emulation
Define bandwidth and latency for each simulated user
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Developer Integrations- Plug-ins for integration into agile / continuous integration tools- Full REST API for custom integration- APM integration for detailed application monitoring- Detailed error reporting- Fully automated spin up / down of dedicated servers- 100% compatible with open source scripting (JMeter)
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Load Testing Steps
• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Load Testing Steps
• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Detailed Reporting- Performance Testing KPIs- Waterfall Report with Detailed Timings- Error Report- Real Browser Timings with Selenium- Server Monitoring- Front End Page Speed Recommendations- Application Performance Monitoring- JMeter Logs
BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | info@blazemeter.com
Detailed ReportingLoad Results APM - New Relic Real Browser - Selenium
Waterfall Front End Recommendations Errors