5 Things to Keep Monitoring After Black Friday / Cyber Monday

13
#MonitorAfterBFCM Five Things To Monitor After Black Friday / Cyber Monday Baron Schwartz - VividCortex

Transcript of 5 Things to Keep Monitoring After Black Friday / Cyber Monday

Page 1: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

Five Things To Monitor AfterBlack Friday / Cyber Monday

Baron Schwartz - VividCortex

Page 2: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

● Last time I talked about specific things to validate pre-peak

● This time it’s five quick things to keep track of post-rush

A Quick Win

Page 3: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

The 5 Things1. Keep an eye on disk space2. Watch your latency changes3. Check for performance regressions4. Assess capacity ceilings5. Plan for 2017

Page 4: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

Code Slush● Etsy and VividCortex both use a

bit of extra caution while deploying in the holidays

● Hard “freezes” are counterproductive

● See my blog for more: https://goo.gl/5ojHPU

● This does add a bit more risk, though

Page 5: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

1. Watch Disk SpaceFull disks are one of the most common causes of outages.

Did you make any changes while firefighting that you haven’t “cleaned up” or brought back into your Puppet/Chef config?

Page 6: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

2. Watch For Latency Increases● Latency increase in an “important” query● Use time-vs-time profiling with the Latency column in VividCortex● Profiler > Queries by Total Time > Compare > look at Count, Latency

Page 7: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

3. Watch For Performance Regressions● Increase in key parts of the workload

○ Use Profiler / Queries By Total Time○ Configure alerts on query anomalies○ Use long-term trending to spot gradual changes, e.g. “last 1 week” time range

● Newly released queries○ Configure alerts on new queries that are significant○ Use the Queries dashboard, toggle the “new” option

Page 8: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

Page 9: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

4. Assess Capacity CeilingsWe talked about the USL last time. You can download our ebook and Excel workbook to learn more and do your own modeling. Two new things you can now do:

● Model with higher real load than you previously were able to see

● See if your pre-peak predictions were right!

Page 10: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

Actual Customer Server with USL Model

Page 11: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

5. Plan For 2017A few things to do as you look ahead to 2017’s peak season:

1. Write down, take notes, save screenshots, etca. VividCortex has a “time range bookmark” feature you might find helpful

2. Compare normal vs peak loada. What’s the ratio?b. What will you be able to project about 2017’s traffic based on 2017 normal?

Page 12: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

Upcoming Webinar

Page 13: 5 Things to Keep Monitoring After Black Friday / Cyber Monday

#MonitorAfterBFCM

Thanks! Questions?● Baron Schwartz● [email protected]● @xaprb