Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015...

25
1 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015 Best practices for synthetic monitoring SaaS data analysis Master the moving parts:

Transcript of Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015...

Page 1: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

1 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Best practices for synthetic monitoring SaaS data analysis

Master the moving parts:

Page 2: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

2 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• Why does performance matter?

• Key Issues & Best Practices - What we see in the field

• Specific examples of key issues

• How do we look at data

Agenda

Page 3: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

3 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE3

Performance in ContextWhat matters most

Page 4: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

4 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• Google is not the goal

• There is a point when fast is fast enough

• Optimize only what impacts the customer and drives business outcomes

How Fast is Fast Enough?

Page 5: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

5 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Don’t buy a tool…enable a process that impacts your customer’s experience

Page 6: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

6 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Lots of data but need to knowwhat it means

Need to understand how we compare to the competition

Need to understand root causesof performance problems

Once I know what it means I need to make it actionable

Page 7: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

7 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Tool Data Insight Customer Impacting Action

Page 8: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

8 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Where Should I Focus?

CustomerExperience

ContentCreation

Internalteams

Agencies

ContentMgmt

Systems

TechnicalImplementation

Local LoadBalancing

(multi)

ISP Selectionand

Optimization

Routing(BGP)

Local LoadBalancing

DNS/network

ServerInfrastructure

Compression

Capacity

ApplicationCode

JVM

DB systems

Internal/ExternalHosting

Third PartyIntegration

WebServices

PaymentSystems

HybridContent

ContentDelivery

CloudServices

CDN

RouteOptimization

Hosting

Cloud

Shared/dedicated

Multi-dataCenter

Outsourced

Front EndAppDev

HTML

JS

AJAX

Flash/Flex

Tracking&

Analytics

A/BTesting

CampaignTracking

Omniture/Google

Analytics

ContainerTags

Floodlight/Dart

Page 9: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

9 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE9

Key Issues & Best Practices

Page 10: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

10 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Internal Fragmentation

Page 11: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

11 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

ResponsiveDesign

Page 12: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

12 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Third Party Explosion

Page 13: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

13 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

SPA Applications

Page 14: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

14 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• Enabling gzip compression

• Using persistent connections

• Image size control

• Lack of JS/CSS consolidation/minification

• Poor cache control settings

The Basics

Page 15: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

15 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE15

Troubleshooting Key Issues

Page 16: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

16 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE16

Key Questions• What was the overall user impact?

• High/Medium/Low

• Was this my problem?

• Application Layer/Internal

• Was this a 2nd or 3rd party problem?

• Content that is required for core site functionality or peripheral?

• Is this a point in time operational issue or is it an ongoing problem?

Page 17: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

17 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Application issues:The slow time to first paint (7.8s) is tied to a slow and variable application callThe registrationPage.html call is generally slow and increasingly variable in performance

Page 18: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

18 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• You can see the impact that variability of this call would have in these extreme cases

Application Issues:

Page 19: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

19 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• In this example we see an extremely slow static request loading from a secondary SSL domain (unnecessarily), which is directly blocking the render of the page due to the extra SSL connection time of the new domain –unnecessarily adding ~300ms of time in the case

Slow Static Content:

Page 20: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

20 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• In this example we see that an extremely slow 3rd

party request to kickfactory.com is directly impacting the onload event, and as a result delaying any JS dependent on Onload and

3rd Party Issues:

Page 21: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

21 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

• Here is an example of significant browser processing directly impacting both the initial render of the page (tied to onclicktracking, as well as dommanipulation) along with blocking the onload event at the bottom of the page

Browser Processing Issues:

Page 22: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

22 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE22

How we look at data

Page 23: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

23 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

How am I doing?

Page 24: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

24 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Design Drilldown

Page 25: Master the moving partsthe+moving... · 6 COMPANY CONFIDENTIAL –DO NOT DISTRIBUTE #Perform2015 Lots of data but need to know what it means Need to understand how we compare to the

25 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Perform2015

Competitive Context