Devops at SlideShare: Talk at Devopsdays Bangalore 2011

27
We deploy 5 times a day on production DevOps at SlideShare Kapil Mohan & Mayank Joshi Devopsdays Bangalore 2011

description

Presentation for the talk at Devopsdays Bangalore 2011 (August 26th & 27th) This is about why we embraced devops at SlideShare and our experiences, achievements and insights in adopting devops.

Transcript of Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Page 1: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

We deploy 5 times a day on production

DevOps at SlideShare

Kapil Mohan & Mayank JoshiDevopsdays Bangalore 2011

Page 2: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

http://slideshare.net/kapil/meeting/live

Page 3: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

The Plan

1) Why DevOps @SlideShare?

2) Tools & culture for DevOps

3) Q & A

Page 4: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

The Plan

1) Why DevOps @SlideShare?

2) Tools & culture for DevOps

3) Q & A

Page 5: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Once upon a time...

Deployments to production for 4 months: ZERO

Everybody was scared to deploy

Deployment was a tedious job

Page 6: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

F%#K

Deployment Day!

Ops guy's hand

Page 7: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Manual steps to setup a new server

Non-repeatable, error-prone,un-maintainable

~1 server/guy/day

BORING!

WTF slide of the day

Page 8: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Long downtimes

Time wasted in digging the root cause

Time wasted in adding capacity

Site Down

Page 9: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Zero visibility led to arguments & blames

No shared responsibility

It's Your Problem

Page 10: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

...and

Crazy growth, millions of users worldwide

Engineering needed to scale up!

Page 11: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Why DevOps @SlideShare?

Deployments were a blocker

Building & maintaining servers was PITA

Zero visibility into the system

No shared ownership

Needed better engineering practices

Page 12: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Agile & Lean

Page 13: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

http://slideshare.net/jallspaw/10-deploys-per-day-dev-and-ops-cooperation-at-fl ickr

Page 14: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

The Plan

1) Why DevOps @SlideShare?

2) Tools & culture for DevOps

3) Q & A

Page 15: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Systems Automation!

Object oriented, incremental, repeatable

5-50 today!

IP for the company

Ruby – readable by devs

Page 16: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Scripted Deployments

Repeatable, powerful

No release manager

Devs “see” their code going to production

Ops can deploy on their own

Page 17: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Source Control

Moved from SVN to Git

Using GitSVN glue

Merging, branching FTW!

Dev and Ops can access all repositories

Page 18: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Continuous Integration

BDD using RSpec

Centralized build server using CCrb

Web-based dashboard

Blackbox application testing using Selenium

Page 19: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Ruthless Monitoring

Web-based performance dashboards (New Relic, Ganglia)

Detailed, time-based profiling

Devs have visibility

Page 20: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Alerting

Web-based dashboard, emails, SMS

Nagios everything

On-call Devs!

Page 21: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Visibility

Akamai

Website Pulse

Slow query reportsNagios alerts

Page 22: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Management's Role

IRC, Email, Phone, Face to face - Get them to 'talk'

Force collaboration when troubleshooting issues, downtimes

Build cross functional teams

STOP blaming!

Page 23: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Tools & Culture

Page 24: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

5 deployments a day :)

Page 25: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Thank you

Page 26: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

We are hiring!

http://slideshare.net/about/workatslideshare

Page 27: Devops at SlideShare: Talk at Devopsdays Bangalore 2011

Image credits

Image on slide 6 - http://www.rodcolledge.com/rod_colledge/2009/03/dbas-behaving-badly-110-backups.html Image on slide 9 – http://www.lifehack.org/articles/communication/how-to-win-arguments-dos-donts-and-sneaky-tactics.htmlImage on slide 10 (top right) – http://labnol.blogspot.com/2007/09/slideshare-upload-ppt-presentations-pdf.htmlImage on slide 12 (left) - http://blog.une.edu.au/robbi/category/design/Image on slide 12 (right) – http://www.startuplessonslearned.com/Image on slide 15 – http://adainitiative.org/2011/04/puppet-labs-sponsors-the-ada-initiative/Image on slide 16 – http://decrypt.ysance.com/2010/06/cloud-aws-infrastructure-vs-physical-infrastructure-1/