Technology Solutions Monitoring Adverse Events in … · (nintedanib) and Roche’s Esbriet ...
Mobile Monitoring for Peak Events
-
Upload
perfecto-mobile -
Category
Technology
-
view
136 -
download
3
Transcript of Mobile Monitoring for Peak Events
![Page 1: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/1.jpg)
Grand National 2015Mobile application performance insightsHow to get monitoring right with millions of users
![Page 2: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/2.jpg)
Perfecto Mobile The world leader in mobile application continuous quality helping the world’s biggest brands to deliver better apps faster
“Perfecto Mobile currently has the strongest 3rd party position in the market” [ Thomas Murphy]
Intechnica• Vendor/Technology Independent• Enable Performance by Design• Provide Performance Management Services• Specialists in Agile Performance• Enable and deliver Performance Best Practice
![Page 3: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/3.jpg)
Your presenters:
Larry HaigSenior Performance Consultant, [email protected]+44 (0)845 054 2381Contributing author: The Art of Application Performance Testing[Molyneaux, 2nd Ed 2014 Pub O’Reilly]
Amir RozenbergDirector, Product Management, Perfecto [email protected]
![Page 4: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/4.jpg)
Agenda
Grand National: Fast Facts
Our Findings
The Next Race
Best Practices
Demonstration
vv v
v v
![Page 5: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/5.jpg)
Grand National 2015 – fast facts
• OpenBet record 19,300,000 bets within 24 hours– Peak 45,000 bets pm– 54,000,000 account transactions [UK population c63m (2011)]
• + 24% y-o-y– Average bet size is £8.00 – 63% of remote bets via mobile, – [up from 54% 2014]
• UK Transaction volume +12.6% y-o-y– (+83.6% vs typical April trading day)
• UK Transaction value + 20.3% y-o-y Refs: OpenBet; Worldpay
![Page 6: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/6.jpg)
Survey & caveats• Focus on Mobile perspectives, end user/client side issues
– Android and iOS– Complementary testing:
• Mobile emulation / public carrier (4G) / webkit browser (m. sites)• Real device testing (native apps)
• Raceday & 2 day buildup• High vs low traffic• Performance and Quality of Service• Caveats:
– Snapshot testing – indicative, not absolute / continuous– High level monitoring only
• No device metric correlation – Real device test redundancy limited
• Native App availability not quoted
Example – race day errors log
![Page 7: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/7.jpg)
Summary of key findings• Overall performance improving y-o-y, BUT• Still evidence of traffic related stress• All m. sites (and some native apps) showed some evidence of Quality of Service
issues– 85%+ likely to be revenue relevant– Brand impact
• m.sites:– iPad2 Tablet slower than Smartphone– 3rd party content source of failure– Lack of traffic resilience– Transaction payload highly correlated with performance
![Page 8: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/8.jpg)
Summary – traffic & payload:
![Page 9: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/9.jpg)
Summary – traffic & payload:
![Page 10: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/10.jpg)
NATIVE MOBILE APPLICATIONS
![Page 11: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/11.jpg)
Native App Response Times by Device- The Good
4.23s 2.59s 2.91s 8.06s
5.16s 9.32s 5.67s 1.48s
Web Emulation = 1.15s
![Page 12: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/12.jpg)
Poll
v
Impact of 5 second delay in a revenue transaction
• I would call customer support• I would complain on social networks• I would transition to competitor application• I would try again
![Page 13: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/13.jpg)
Poll Results
v
Impact of 5 second delay in a revenue transaction
I would call customer support
5%
I would complain on social networks
5%
I would transition to a competitor application
56%
I would try again35%
![Page 14: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/14.jpg)
Native mobile applications – maximized revenue?
Mobile Advertising on app launch takes user attention
Application behavior in absence of network- opportunity to optimize experience
![Page 15: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/15.jpg)
Native applications Panel performance – ‘Time to Bet’
Panel # Android iOS
10 5.0
7 8.9
8 5.1 3.4
9 5.9 1.5
13 10.2 5.0
< 5 sec
>5 - < 10 sec
> 10 secRaceday median (seconds)
![Page 16: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/16.jpg)
Performance consistency (raceday):
0600hrs 11 AprilTran
sacti
on re
spon
se (s
econ
ds)
![Page 17: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/17.jpg)
Example root cause analysis
0
10
20
30
40
50
60
70
80
90
100
0
50000
100000
150000
200000
250000
300000
350000
400000
CPU User (%)#Device CPU Total (%)#DeviceBytes In - WLAN#Device
![Page 18: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/18.jpg)
Rapid find & fix - root cause analysis - drilldown
• Network wait: Client side processing
• Large JavaScript D/L: Repeated downloads
• Significant advertising/tracking/3rd party activity
![Page 19: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/19.jpg)
Brand impact [race day errors]:
![Page 20: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/20.jpg)
PLANNING FOR THE NEXT PEAK EVENT
![Page 21: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/21.jpg)
Digital Experience Unhappy PathNew Use Cases
What will the next race look like?
![Page 22: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/22.jpg)
Quality of Experience- Adopt the user “glass”
Server Architecture Delivery Chain Devices & User
3rd party
Device Emulation UX Timer App-level CPU Peak
iPhone 6 0.9s 1.15s 67%
iPhone 4S 0.9s 8.9s 85%
Typical Application Launch Time
Recommendation 1
![Page 23: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/23.jpg)
Daily Weekly
Sensors (NFC, BT)
Events
Incoming (Call/SMS/Alert)
Location
Rotation
WiFi On/Off
Airplane mode
Dynamic Backend Switching
Light/Heavy Load
Device Stress
Restricted Permissions
Environments
Network Conditions
Sensor allocation
UI AssetsOS & App-level Vitals
Optimization Directions
Reporting
Rich Media QoE
KPIs
Network Traffic
Continuous Quality Lab
Performance TestingAdvanced Functional Testing
Recommendation 2
Test, Optimize & Get Ready
![Page 24: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/24.jpg)
Recommendation 3
Alerting Drives Early Awareness (MTTK) &
correction (MTTR)Real DevicesCoverage
Geos/Scenarios/Carriers
Remain in control:Know early, resolve early, and keep winning!
![Page 25: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/25.jpg)
Key suggestions for monitoring1. Understand customer devices, locations, trends2. Monitor appropriately and manage all digital delivery channels
– PC, m.– Native mobile applications– Other (in store kiosks, etc.)
3. Lean is fast – manage page weights in m. sites4. Audit & optimise client side/application components5. Explicitly monitor object rendering6. Understand device specific effects 7. Manage 3rd party inclusions
– SLAs, monitoring8. Plan ahead
– Understand traffic load effects ahead of time– Baseline key metrics
![Page 26: Mobile Monitoring for Peak Events](https://reader035.fdocuments.in/reader035/viewer/2022062320/55c2bf4dbb61ebc52d8b471c/html5/thumbnails/26.jpg)
www.intechnica.co.ukwww.perfectomobile.com
Thank you.