Monitoring & Troubleshooting In a Containerized World

33
Information presented is confide Monitoring & Troubleshooting in a Container Centric World

Transcript of Monitoring & Troubleshooting In a Containerized World

Page 1: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Monitoring & Troubleshooting in a Container Centric World

Page 2: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

About Sysdig & Chris• The first and only comprehensive,

container-native monitoring solution.• Opensource tool: sysdig• Commercial Product: Sysdig Cloud• Speaker– Chris Crane– VP of Product

Page 3: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Containers Are Taking the World by StormContainers Enterprise Adoption

Using or Investigating Containers Not Using nor Investigating Containers

Source: The Current State of Container Usage, ClusterHQ & DevOps.com, June 2015

93

7

Page 4: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

… For Good ReasonContainers enable

the modern software paradigm

Lightweight VMs EnablingCI/CD + DevOps

Building block for Microservices

Page 5: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Containers Are Great...

• Lightweight & Efficient

• Dynamic

• Reproducible & Portable

Page 6: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Containers Are Great...

…but seeing inside

containers is HARD.

Page 7: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Visibility in a Container World

• Infrastructures are exponentially more:– Scaled– Dynamic– Complex

• New container-native technologies• Containers are black boxes

Page 8: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Catch 22

How can I continue to innovate and evolve

my application infrastructure without

sacrificing visibility!?

Page 9: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Container-Native Performance Management

Page 10: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Container-NativePerformance Management

1. 100% visibility with no instrumentation and no extra burden

2. Deep awareness of container-native technologies

3. Microservice oriented output and user experience

Page 11: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Container-NativePerformance Management

1. 100% visibility with no instrumentation and no extra burden

2. Deep awareness of container-native technologies

3. Microservice oriented output and user experience

Page 12: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Traditional VM Monitoring

CoreApp

Infr.App

Virtual Machine

Network & Infrastructure

Agent• Full visibility of

applications and infrastructure

• Lightweight agent• All good…

Page 13: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Container Visibility Options

1. Agents inside every container

2. Agents outside containers

3. Monitoring as a Microservice

Page 14: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Agent In Every Container

Container

App

Agent

Container

App

Agent

Container

App

Agent

Container Orchestration and Tooling

Host OS

Network & Infrastructure

• Full visibility, but…• Undermines key

benefits of containers:– Light weight– Portability– Reproducibility

Page 15: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Agent In Every Container

Container

App

Agent

Container

App

Agent

Container

App

Agent

Container Orchestration and Tooling

Host OS

Network & Infrastructure

• Full visibility, but…• Undermines key

benefits of containers:– Light weight– Portability– Reproducibility

Page 16: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Agent In Its Own Container

Container Container

Container

Agent

Container Orchestration and Tooling

Host OSNetwork & Infrastructure

• Respects containers, but…• Containers are black boxes• Unsustainable setup +

maintenance issues• Significant scalability issues

Page 17: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Agent In Its Own Container

Container Container

Container

Agent

Container Orchestration and Tooling

Host OSNetwork & Infrastructure? • Respects containers, but…

• Containers are black boxes• Unsustainable setup +

maintenance issues• Significant scalability issues

Page 18: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Container-Native Monitoring

What if we started from scratch and re-architected monitoring

from the ground up forcontainerized environments?

Page 19: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Monitoring as a Microservice

Container Container

CoreApp

Infr.App

Monitoring Container

Container Orchestration and Tooling

Host OSNetwork & Infrastructure

Page 20: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Why Monitoring as a Microservice?

• Aligns with container + microservice principles

• Full visibility• Support for ecosystem• Highly scalable +

dynamic• Zero setup / zero config

Container Container

CoreApp

Infr.App

Monitoring

Container

Container Orchestration and Tooling

Host OS

Network & Infrastructure

Page 21: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Why Monitoring as a Microservice?

• Aligns with container + microservice principles

• Full visibility• Support for ecosystem• Highly scalable +

dynamic• Zero setup / zero config

Container Container

CoreApp

Infr.App

Monitoring

Container

Container Orchestration and Tooling

Host OS

Network & Infrastructure

Page 22: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Sysdig Container-Native Architecture

1. Instrument host operating system

3. Ingest in Monitoring Container

4. (Optionally) save to trace file

2. Capture process +

container activity

Page 23: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Sysdig Products

haproxy nginx

mongo sysdig

sysdig(command line tool)

- Open Source- Single machine- Troubleshooting-focused

Sysdig Cloud(SaaS and OnPrem)

- Commercial Solution- Distributed- Monitoring/alerting/troubleshooting

Page 24: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Demo

Page 25: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Get Started With Sysdig!

SysdigOpen source system and container visibility

www.sysdig.org

Sysdig CloudContainer-native monitoring and alerting platform

www.sysdig.com

Mention this online meet-up for 20% off!

Page 26: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Appendix

Page 27: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Standard Monitoring

Application HealthChecks

System/Process

Infrastructure

CustomMetrics

Dashboards

Alerts

Analytics

Monitoring

JVM

TrendsData Engine

Page 28: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Standard Monitoring for Container-Based Microservices

Application

System/Process

Infrastructure

CustomMetrics

HealthChecks

Dashboards

Alerts

Analytics

Monitoring

JVM

TrendsData Engine

Page 29: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Microservice-NativePerformance Management

Application HealthChecks

System/Process

Infrastructure

CustomMetrics

JVM

Dashboards

Alerts

Analytics

Monitoring

Trends

Requirement #1: 100% visibility, with no instrumentation and no extra burden

Data Engine

Page 30: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Microservice-NativePerformance Management

Application HealthChecks

System/Process

Infrastructure

CustomMetrics

JVM

Dashboards

Alerts

Analytics

Monitoring

Trends

Requirement #2: Deep awareness of container-native, microservice-native technologies

CoreOS

Mesos

Kubernetes

Docker

Swarm

Data Engine

Page 31: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Microservice-NativePerformance Management

Requirement #3: From monolithic to service-aware

Dashboards

Alerts

Analytics

Monitoring

TrendsData Engine

Service1

Service2

Service3

Actions

Page 32: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

Deployment Options

• Subscription-based SaaS– Per host cost: ~$20– Container friendly pricing

• On-premises deployment– Custom pricing

Page 33: Monitoring & Troubleshooting In a Containerized World

Information presented is confidential

No Plugins.. No Config.. No Instrumentation