Preparing for Holiday Performance, API edition
-
Upload
smartbear-software -
Category
Technology
-
view
650 -
download
1
Transcript of Preparing for Holiday Performance, API edition
@SmartBear #HolidayAPISpeed
Preparing for Holiday Performance, API edition
@SmartBear #HolidayAPISpeed
This session is being recorded. We’ll send it to you via email.
Tweet questions using #HolidayAPISpeed
You can also ask questions in the right
chat panel. We’ll address them at the
end.
Answer our quick survey after the
webinar!
•
•
•
•
Housekeeping
2
@SmartBear #HolidayAPISpeed
Our Speakers
3
Mark TomlinsonAPI Performance Consultant
PerfBytes, STP Radio@mtomlins
Paul BruceAPI Product Manager
SmartBear Software@PaulsBruce
Michael PunskyPresident & Load Testing Guru
at FTL Metrics@mpunsky
@SmartBear #HolidayAPISpeed
Why you should have an API performance strategy in place before the holiday rush
Challenges simulating load and themetrics that matter most in API performance
API Performance in action!
Takeaways and Q&A
1.
2.
3.
4.
5.
What we’ll cover today
4
The effects of API performance on theuser’s experience
@SmartBear #HolidayAPISpeed
Webinar Attendee Statistics
0%
61%
39%
How important is API Performance to your organization?
Not important atall
Growingimportance
Very important
30%
70%
0%
How much API Load testing do you do today?
None
Some
Extensive
39% of attendees for this webinar responded that API
performance is “very important,” and yet 30% responded that they
are doing NO load testing at all.
@SmartBear #HolidayAPISpeed
• New & unanticipated workloads
• Unknowns will soon be known
• Data patterns change
• Preparation before, not after
API Performance during the Holiday Season
@SmartBear #HolidayAPISpeed
Daily volumes vs. holiday peaks
@SmartBear #HolidayAPISpeed
Amazon, Aug 2013, 40mins, $5m
Mins of downtime * avg. revenue / min
= downtime losses
Third party downtime affects everyone
API performance affects mobile & web apps
Case in point: the cost of downtime
@SmartBear #HolidayAPISpeed
What’s at risk?
@SmartBear #HolidayAPISpeed
Nike+ FuelBand
Fitbit
Jawbone UP24
Amazon Nest
Phillips Hue
Internet-connected TVs
The 2014 Gadget Craze
All of themuse APIs!
@SmartBear #HolidayAPISpeed
Hate to make you wait...but...
Back-end “latch” time on middle-tier resources
After two seconds, you’re only a swipe away
Mobile uninstall
New browser tab to competitor
Wait time allows for distraction from UX
goals
Effects of slow APIs on UX
@SmartBear #HolidayAPISpeed
What kind of tests do you really need?
How do real conditions differ from testing efforts?
What are your expectations?
How do you set your performance goals?
What’s your one-x load?
Which multiples of one-x impact your business?
Where & why do multiples of one-x occur?
What it looks like to simulate…
@SmartBear #HolidayAPISpeed
Common (web / mobile / API)
Total round-trip time on individual calls
Failures that the simulation elicited
Server metrics (effect of load on resources)
Web-specific metrics
Page, ATF (perceived user metrics)
UX and Interaction workflows
API-specific metrics
Throughput: TPS, BPS, queued (arrival)
Metrics: traditional vs. API data
@SmartBear #HolidayAPISpeed
Identify critical real-world workflows
Isolate the critical waypoints (API transactions)
Test parts & the whole, not just either/or
Sharing the results
API Monitoring to API development teams
Load test results with Ops
Summarizing results to management
Putting the customer experience 1st
@SmartBear #HolidayAPISpeed
API
Focus on API Performance
Load Testing
in
Performance Monitoring
in
@SmartBear #HolidayAPISpeed
Better to find out now than later
What you’re losing
Revenue
Consumers
Brand trust
Automating makes room in the schedule
Not everything is a priority; base it on data
What if we don’t have the time?
@SmartBear #HolidayAPISpeed
API Providers: SLA is a promise not to be broken
API Consumers: 3rd party problems are your problems too
Decision-makers: Visibility on API performance is critical
to have before the holiday rush
Developers: fast, regular performance checks help to
keep your backlog clean
Testers: Load testing makes you a rock star
Key takeaways
@SmartBear #HolidayAPISpeed
Thank you to our experts!
Mark Tomlinson
PerfBytes, STP Radio
Michael J. Punsky
FTL Metrics, SmartBear
@SmartBear #HolidayAPISpeed
Q & A
Try API Load Testing For Free
FREE TRIAL