Nikhil Vaze - Electric Cloud - Create your own self-service cloud: Docker containers as part of a CD...

© Electric Cloud | electric-cloud.com

Nikhil Vaze | @therealnikhil | DOES 2015

CREATE YOUR OWN SELF-SERVICE CLOUD: DOCKER CONTAINERS AS

PART OF A CD PIPELINE


Introductions

Nikhil Vazehttps://github.com/nikhilv@therealnikhil

Staff Software Engineer at Electric CloudFull stack engineer and loves to hack on things. Johns Hopkins University Alum

https://github.com/nikhilv


DEV

OPS

Electric Cloud: Powering Continuous Delivery

ElectricFlow

Deploy

Pipeline Management and Visibility

ElectricAccelerator

Build & Test Acceleration

DevOps Automation Platform (ElectricFlow)

Build

DELIVERY

Plugs right in to your existing tools

CONTINUOUS

Build Test


I spend my time on integrationsSource Control, Defect Tracking, Databases, Clouds, Testing tools , Application Servers….


Our integrations are going Open Source

https://electric-cloud.github.io/


Experience with DockerGeneral interest in Docker, containers and application deployment.

Docker Santa Clara Co-organizer: http://www.meetup.com/Docker-Santa-Clara/

Docker Hackathon 2014http://blog.docker.com/2014/07/dockercon-video-dockercon-hackathon-winners/

Lightning demo @ DOES ‘14 Docker and Application Deployment

http://blog.docker.com/2014/07/dockercon-video-dockercon-hackathon-winners/





Docker Survey: Keep your hands up if …

If you’ve heard of DockerYou’ve typed ‘docker run…’You use docker in dev/testYou use docker in production

You have exported a docker container and run it with systemd-nspawn


Overview: The pain of procuring new IT systems


Ring a bell?

Source Docker Con 2015: https://www.youtube.com/watch?v=RaSzmFkf4fM

https://www.youtube.com/watch?v=RaSzmFkf4fM



Enterprises have not adopted the cloud

Source: Intel presentation @ OpenStack Silicon Valley 2015


Fortune 500 use case


Fortune 500 company (repeat picture)

Source Docker Con 2015: https://www.youtube.com/watch?v=RaSzmFkf4fM




Challenges

One group provides infrastructure. Another group provisions software on top of the infrastructure. Another group performs the data load onto the software/infrastructure.

Cons:Quite expensive. Front loaded. If you want this particular app loaded for testing. It will involve x thousands of dollars of cost.

Process encouraged bad behavior. Users were requesting infrastructure and never letting it go.


(The Actual slide)


Enter Electric Cloud!


Question we (Electric Cloud) asked ourselves ~ early 2014

- Who else was facing this?

- Could we make this a feature?

- Does the introduction of Docker change things?


Dynamic Environments / Self Service Clouds


Answers we (Electric Cloud) gathered~ mid/late 2014

- Who else was facing this?- Common problem facing the industry

- Could we make this a feature?- Yes.

- Does the introduction of Docker change things?- Yes. And it’s the future.


What are Dynamic environments?

Define once, provision repeatedly Define a blue print. Make it available to your users

Cloud ready Apply the blue print to your cloud

Configuration Management ready Already have a blue print in your CM tool? No problem!

Docker ready


Intro Docker*


Enter Docker

• https://docker.io/• Open Source• Used to wrap LXC, now has its own container implementation• Really, really fast. Start measuring in milliseconds

https://docker.io/

https://docker.io/

https://docker.io/


Docker 102 – Different drivers


Docker 102 containers vs. VMs


Docker 102 VMs vs. Docker


Docker 102, Docker Client, Docker Engine


Docker 102 Diagram of potential Flow dev


Why are people excited about containers?

Builds can be done inside the container, gives file system isolation and reproducibility.

Development/Production Parity. The container is the deployable artifact.

Container start up times measured in milliseconds

Microsoft getting on board!


Explanation of demo


Blog post I’ve extended for this following for this talk

Docker Service Discovery Using Etcd and Haproxy http://jasonwilder.com/blog/2014/07/15/docker-service-discovery/

http://jasonwilder.com/blog/2014/07/15/docker-service-discovery/





Availability Zone ALoad Balancer

HA Proxy

Service Discovery

etcd

NoSQL Database

Couchbase

Application

Dockerized App in Prod


Availability Zone BAvailability Zone ALoad Balancer

HA Proxy

Service Discovery

etcd

NoSQL Database

Couchbase

Application Application

NoSQL Database

Couchbase

Multi AZ Dockerized App


ComparisonBefore After


Load Balancer (HAProxy)


Couchbase

- NoSQL DB- One Dimensional or Multi Dimensional Scaling- Rebalancing

More info: http://blog.arungupta.me/

getting-started-with-couchbase-using-docker/


Front endCreated by Couchbase employees

Node.js, Angular.js and Express front end

Github: https://github.com/tleyden/try-cb-nodejs


Etcd (Service Registry)

etcd is a distributed, consistent key-value store for shared configuration and service discovery, with a focus on being:

Simple: curl'able user facing API (HTTP+JSON)

Secure: optional SSL client cert authentication

Fast: benchmarked 1000s of writes/s per instance

Reliable: properly distributed using Raft


Before I forget…


Try out our community edition!

http://electric-cloud.com/downloads/electricflow/communityedition


Demo


Wrap up


Automation & Self Service Clouds, FTW!

• Cloud may or may not be first step but doesn’t immediately empower all users.

• Self Service can reduce barriers for their users and improve productivity

• Docker makes things easier

• You need automation!


Thank youNetworking

Other Systems

ISV, Internet & Entertainment

Heavy Industry

Financial Services

Automotive Medical Devices

Semiconductor

Aerospace /Defense

Mobile Devices

Q&A

http://images.google.com/imgres?imgurl=http://www.htsalg.com/Bestill/ericsson_logo_darkblue.gif&imgrefurl=http://www.htsalg.com/Bestill/r290%20info.htm&h=658&w=3208&sz=29&hl=en&start=1&tbnid=J0BCxskKEjC_vM:&tbnh=31&tbnw=150&prev=/images?q=ericsson+logo&svnum=10&hl=en

http://images.google.com/imgres?imgurl=http://www.samsung.com/gr/presscenter/images/samsung-logo.jpg&imgrefurl=http://www.samsung.com/gr/presscenter/awards/index.htm&h=290&w=496&sz=15&hl=en&start=1&tbnid=evZTc_XRtk9rGM:&tbnh=76&tbnw=130&prev=/images?q=samsung+logo&svnum=10&hl=en&sa=X

http://images.google.com/imgres?imgurl=http://www.jazzsemi.com/images/services/cadence_logo1.gif&imgrefurl=http://www.jazzsemi.com/services/partners/cadence.shtml&h=138&w=280&sz=5&hl=en&start=1&tbnid=n4WQCNjZ-38tKM:&tbnh=56&tbnw=114&prev=/images?q=cadence+logo&svnum=10&hl=en

http://images.google.com/imgres?imgurl=http://www.swdinc.com/images/Delphi%20Logo.gif&imgrefurl=http://www.swdinc.com/dip_spin_specifications.htm&h=96&w=192&sz=3&hl=en&start=4&tbnid=1BFc3BLdQmvZeM:&tbnh=52&tbnw=103&prev=/images?q=delphi+logo&svnum=10&hl=en

http://images.google.com/imgres?imgurl=http://www.cellmaking.com/images/cell_phone_logos/texas-instruments.jpg&imgrefurl=http://www.cellmaking.com/cell_phone_brand_logos.html&h=160&w=200&sz=7&hl=en&start=1&tbnid=-1cY3MH1qEOLPM:&tbnh=83&tbnw=104&prev=/images?q=texas+instruments+logo&svnum=10&hl=en&sa=X

http://images.google.com/imgres?imgurl=http://www.iamjoshbrown.com/blog/wp-content/uploads/2007/01/DIRECTV.jpg&imgrefurl=http://www.iamjoshbrown.com/blog/2007/01/12/direct-tv-evil-empires-something-worse-than-wal-mart/&usg=__zegoP5a2X8KTc_f_UXZXzcwtH5g=&h=497&w=664&sz=105&hl=en&start=2&sig2=D5t7SaTR__5qwKxOBmgmJg&um=1&itbs=1&tbnid=Ll-sUrpjkNapuM:&tbnh=103&tbnw=138&prev=/images?q=directv&hl=en&rls=com.microsoft:en-us:IE-SearchBox&sa=N&um=1&ei=og0oS5K0GJWvlAeJ_oiVDQ

http://images.google.com/imgres?imgurl=http://www.mediabistro.com/news/original/GE%20Logo.jpg&imgrefurl=http://www.mediabistro.com/news/newsfeed/the_morning_newsfeed_081309_124251.asp&usg=__DmYTdmVzDIYkWfRsrWkNoxQmnC4=&h=250&w=250&sz=19&hl=en&start=1&um=1&itbs=1&tbnid=EFtg0twRh4QqHM:&tbnh=111&tbnw=111&prev=/images?q=general+electric+logo&um=1&hl=en&rls=com.microsoft:en-us:IE-SearchBox&tbs=isch:1

http://images.google.com/imgres?imgurl=http://www.mikesappliances.co.uk/images/Bosch-Logo-1.jpg&imgrefurl=http://www.mikesappliances.co.uk/&usg=__XfxhyZ2Aj8xSIzegkAmjEYJd-tM=&h=286&w=1000&sz=42&hl=en&start=2&um=1&itbs=1&tbnid=YMxBIsC8Kk3KHM:&tbnh=43&tbnw=149&prev=/images?q=bosch+logo&um=1&hl=en&sa=X&rls=com.microsoft:en-us:IE-SearchBox&tbs=isch:1

Nikhil Vaze - Electric Cloud - Create your own self-service cloud: Docker containers as part of a CD...

Software

Transcript of Nikhil Vaze - Electric Cloud - Create your own self-service cloud: Docker containers as part of a CD...