The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container...
Transcript of The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container...
![Page 1: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/1.jpg)
The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015
![Page 2: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/2.jpg)
A story begins…
![Page 3: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/3.jpg)
Servicification of New Relic
![Page 4: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/4.jpg)
Service container life cycle
Long lived Short lived
VM
![Page 5: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/5.jpg)
Theory Docker is a lightweight VM
![Page 6: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/6.jpg)
Let’s monitor it!
![Page 7: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/7.jpg)
Well that was surprising
![Page 8: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/8.jpg)
![Page 9: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/9.jpg)
Apparent customer usage
Long lived Short lived
VM
![Page 10: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/10.jpg)
Theory Docker is a lightweight VM Docker is a cloud compute container
![Page 11: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/11.jpg)
Pets vs Cattle
![Page 12: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/12.jpg)
Along came New Relic Synthetics…
• User authored selenium scripts run in our data center • Each run in its own container for security isolation • Mostly run for under a minute
![Page 13: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/13.jpg)
Along came New Relic Synthetics…
• Test external availability and performance • User authored selenium scripts run in our data center • Each run in its own container for security isolation • Most run for under a minute
![Page 14: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/14.jpg)
A lighter weight usage
Long lived Short lived
VM
![Page 15: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/15.jpg)
Theory Docker is a lightweight VM Docker is a cloud compute container Docker is a short lived compute engine
![Page 16: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/16.jpg)
What the heck’s going on?
Long lived Short lived
VM
? ? ?
![Page 17: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/17.jpg)
1: Hey we’re monitoring it!
![Page 18: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/18.jpg)
2: We’re Data Nerds!
![Page 19: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/19.jpg)
Data set analyzed
CUSTOMERS
Approx. 1000
TOTAL CONTAINERS
8+ million
AVERAGE 24 HR CONTAINERS
300,000+
![Page 20: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/20.jpg)
100
10K
1M 3.7 M
333 days 83 days
![Page 21: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/21.jpg)
100
10K
1M 3.7 M
Like VMs
![Page 22: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/22.jpg)
100
10K
1M 3.7 M
Cloud-ish
![Page 23: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/23.jpg)
100
10K
1M 3.7 M
Lightweight compute engine
![Page 24: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/24.jpg)
![Page 25: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/25.jpg)
3,741,000 46% under one hour
![Page 26: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/26.jpg)
![Page 27: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/27.jpg)
950,000 11% under one minute
![Page 28: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/28.jpg)
27% under 5 minutes (versus a VM?)
![Page 29: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/29.jpg)
June versus now: 5x data, same shape
![Page 30: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/30.jpg)
A surprising result
Long lived Short lived
VM
![Page 31: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/31.jpg)
Why this matters 1. Usage is evolving in (fascinating) unexpected ways
2. Single technology that can span such wide usage is a game changer
3. Monitoring tools need to fit the lifecycle
![Page 32: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/32.jpg)
Takeaways • Same technology spans a huge usage scope
• What explains all this? • Batch jobs? • “Microservices”?
• The missing metric: computational work • There will be a lot more short lived anything
![Page 33: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/33.jpg)
The evolution of computation as a service • Short startup time (orders mag.) allows very short lived computing
• Containers are created • Do their work • Go away
• Containers only exist, and only for as long, as they provide value.
Full stop.
![Page 34: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/34.jpg)
Implications of computation as a service? • What does it mean to network them together?
• What does it mean for orchestration of work?
• What does it mean for CI? Does it increase agility?
• What does it mean for provisioning, load balance, availability?
• How do we know what they’re doing? (And, what is “what”?)
![Page 35: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/35.jpg)
Monitoring servers
![Page 36: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/36.jpg)
Monitoring computation
![Page 37: The Truth about Docker Container Lifecycles · 2017-12-14 · The Truth about Docker Container Lifecycles KEVIN MCGUIRE AUGUST 17/2015 . ... • User authored selenium scripts run](https://reader035.fdocuments.in/reader035/viewer/2022062402/5ede892cad6a402d6669dc55/html5/thumbnails/37.jpg)
Thank you Kevin McGuire [email protected] @KevinMcGUI