ELK for KPI’s - Indico · Elastic Search A distributed, RESTful search and analytics engine...
Transcript of ELK for KPI’s - Indico · Elastic Search A distributed, RESTful search and analytics engine...
ELK for KPI’s
Matt HerbertTechnical Lead, DevOps Automation, Products and TechnologiesJanuary 17, 2016
2
● Matt Herbert● Home: New Hampshire, USA● Started in the industry in 1993● Specializing in Automation● At Red Hat since January 2015● Formerly with Cisco for 8 years
working on 802.1X, VPN, Identity● Love programming in Python● Hobbies: Gardening, Maple Syruping,
Boating, Travel
About Me
[email protected] https://www.linkedin.com/in/mattherbert
3
That which is measured improves. That which is measured and reported improves exponentially.
- Karl Pearson
4
Complexity of the Release Pipeline
5
The Problem
● 100s of servers● Dozens of critical services● Hundreds of packages built every day● Hundreds of advisories released every week
Nothing was measured!
6
The SolutionClick to add subtitle
Measure It!
7
1. Uptime2. Average time to release3. Release success rate4. Release accuracy rate
What should we Measure?
8
Challenges
● Tools not implemented for metrics● Lots of nuance● No data retention policies
9
Data started trickling inGoogle sheets doesn’t scale
10
Elastic SearchA distributed, RESTful search and analytics
engine capable of solving a growing number of use
cases.
LogstashData processing pipeline
that ingests and transforms data, and then sends it to your favorite
“stash.”.
KibanaVisualize your Elastic
search data and navigate the Elastic Stack.
Welcome ELK (aka Elastic Stack)Elastic Search + Logstash + Kibana
11
OperationsCentralized OS and App level logging
QualityTest log storage
Automation + DevelopmentMetrics
Elastic Stack at Red Hat
12
Typical SysOps Kibana Dashboard
13
Jenkins for Orchestration
Collect Data Import to Elastic Search Kibana for Visualization
14
ShipshiftShip Jenkins artifacts to ELK
THANK YOU
plus.google.com/+RedHat
linkedin.com/company/red-hat
youtube.com/user/RedHatVideos
facebook.com/redhatinc
twitter.com/RedHatNews