Behind the Scenes at Coolblue - Feb 2017
48
-
Upload
pat-hermens -
Category
Technology
-
view
270 -
download
2
Transcript of Behind the Scenes at Coolblue - Feb 2017
Behind the Scenes - Feb 2017Pat Hermens [email protected]
All the things.
kibana
elasticsearch
beats logstash
Elastic Stack.
Elastic Stack.
Kibana● “A visualisation tool that ties into Elastic Search”
● Why do we use it?○ It “just works” with the rest of the stack○ Visualisations and dashboards are “good enough” and getting better
Elastic Stack.
Elastic Search● “A performant search engine & data store”
● Why do we use it?○ Great at storing large amounts of data, and ○ Fantastic at searching through it!
Elastic Stack.
Beats● “It ships logs so you don’t have to”
● Why do we use it?○ Lots of machines○ Lots of environments○ Lots of moving parts○ Lots of legacy that we need to support (Thanks FileBeats!)
Elastic Stack.
Logstash● “The entry-point into the Elastic Stack”
● Why do we use it?○ It splits up each log into a separate index ○ It enriches logs...
■ e.g.: Given an IP address, it can add city and country■ e.g.: Given a server name, it can add environment name■ HINT: Given a structured string, it can break it apart
● What is it/what was the predecessor?
● When was it first released?
● Why do we use it?
Log4Net.
Other handy tools.
“structured log visualiser” “in-memory data store”
More tooling.
“Seq is the fastest way for development teams to carry the benefits of structured logging from development through to production.”
More tooling.
+
More tooling.
Nightmares.
SMTPAppender.
PatsCustomAppender.
+
More tooling.
+
More tooling.
+
So much tooling.
So much tooling.
In Production.
For our demo.
Nightmares.
Nightmares.
Monitoring.
Yes, monitoring.
Disclaimer.
The shiniest.
All the new things.
Conclusions.
Conclusions.
Conclusions.
Conclusions.
Conclusions.
● Documentation & code from tonight:○ https://github.com/phermens-coolblue/bts-2017-february/
● Seq running on a Windows Server Core image:○ https://github.com/phermens-coolblue/bts-2017-february/tree/master/docker/seq
○ ...or https://hub.docker.com/r/pheonix25/servercore-seq/
● ELK & Redis running on Docker:○ https://github.com/phermens-coolblue/bts-2017-february/tree/master/docker/elk
● Coolblue DevBlog: ○ http://devblog.coolblue.nl/
● Slides (and possibly video) will be available soon:
○ @phermens, or https://hermens.com.au
Links.
Behind the Scenes - Feb 2017Pat Hermens [email protected]
