Post on 23-Jan-2018
Who am I?
@WillLaThoughts
@WillLaThoughts
Minimum Viable Product Incident Runbooks
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
WTP?SupportsTeamMembers
MitigatesConfusionReduceDelays
ContinuouslyImproveEtc.
@WillLaThoughts
WTF?@WillLaThoughts
Pains Challenges PAINS
• Quickly remediating service disruptions• Quickly identifying the right alerts• Lack of actionable alerts• Knowing who to collaborate with
Pains Challenges PAINS
• Quickly remediating service disruptions• Quickly identifying the right alerts• Lack of actionable alerts• Knowing who to collaborate with
• Too much alert noise• Unclear accountability• Accommodating new tech in the stack• Humans
@WillLaThoughts
GatherTribalKnowledge@WillLaThoughts
GatherTribalKnowledge
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
:)
WHOWHATWHEREHOW
@WillLaThoughts
Collaboration Action Items
1. I checked Host.104...
2. Is the service...?
3. What’s the graph...?
4. Is Tina online?
1. Check Host.104
2. Check service
3. Analyze graph
4. Tina can be found here
@WillLaThoughts
It!@WillLaThoughts
GetthoseURLsdisplayedrightwhenthealertoccurs
PlatformthatcanattachtheURLtoalertsWebhook toemailCommandin.cfg
Ifthis{alert},thenthat{runbook}Etc. @WillLaThoughts
FEEDBACK
Nice
No
NoNo Nice
Nice
Nice
Nice
Nice
Nice
Nice
Nice
Nice
???
FEEDBACK- ADJUST
Nice
???
???
@WillLaThoughts
“Something” > [null]
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
@WillLaThoughts
WTF?@WillLaThoughts
@WillLaThoughts
VictorOps IntegrationsQuestionsorVictorOps Demo?=Contactinfo@victorops.com orsales@victorops.com