Post on 19-May-2015
description
Open Source Tools and Operations Methodologies for Unlocking the Business
Value of the Cloud
Saturday, April 23, 2011
• Open Source Tools• Operations Methodologies• Business Value of Cloud
Saturday, April 23, 2011
Buying or Building a Cloud Does Not Make Your
Business Agile!
Saturday, April 23, 2011
Buying or Building a Cloud Does Not Make Your
Business Agile!
Building a Cloud is EasyManaging a Cloud is Not!
Saturday, April 23, 2011
Agenda
• Introductions
•Devops
•Devops Stories
•A LeanOps Success Story
•How You Can Deliver LeanOps
Saturday, April 23, 2011
Company Background
• Founded in 2004 from:
• eTrade, NASA, Fidelity, Schwab
• Canonical, Opscode
•Agile IT and Operations Team
• Over 100 person-years and 6 books
• Financials, telco, transpiration, etc.
•Headquartered in San Mateo CA
• Offices in Atlanta, and San Francisco
Saturday, April 23, 2011
Our Customers
Saturday, April 23, 2011
john@dtosolutions.com
John Willis
twitter.com/botchagalupe
Saturday, April 23, 2011
Operations: The Elephant in the Room
Once we move to software as a service, everything we thought we knew about competitive advantage has to be rethought.
Tim O'Reilly - Operations: The New Secret Sauce
Saturday, April 23, 2011
XaaS
Saturday, April 23, 2011
XaaS
"anything as a service" or "everything as a service." The acronym refers to an increasing number of services that are delivered over the Internet rather than provided locally or on-site.
Saturday, April 23, 2011
The New Face of a Rock Star
John Allspaw - VP of Technical Operations at Etsy
Saturday, April 23, 2011
Devops is a cultural and professional movement!
Saturday, April 23, 2011
Devops is About Velocity
Saturday, April 23, 2011
Devops is About Velocity
Velocity of Innovation
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Devops
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Devops
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
DevopsAgile IT
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
DevopsAgile IT
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Devops
Lean Startup
Agile IT
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Devops
Lean Startup
Agile IT
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Devops
Lean Startup
Agile IT
EnterpriseLean Startup
Saturday, April 23, 2011
LeanOps
Is a commodity based software infrastructure that focuses on eliminating
waste and reducing the time between market assumptions and customer
delivery.
Devops
Lean Startup
Agile IT
EnterpriseLean Startup
Saturday, April 23, 2011
Devops Lifecycle
ah ha! ka ching!
Dev
Business Process
Remove
Shorten
Ops
Saturday, April 23, 2011
Devops Lifecycle
ah ha! ka ching!
Dev
Business Process
Remove
Shorten
Ops
Compressed SDLC
Saturday, April 23, 2011
Typical Ops Resources
Saturday, April 23, 2011
Typical Ops Resources
LeanOps
Saturday, April 23, 2011
Typical Ops Resources
LeanOps
Saturday, April 23, 2011
Typical Ops Resources
LeanOps
Saturday, April 23, 2011
LeanOps Loosely Coupled Toolchain
Saturday, April 23, 2011
LeanOps Staff Allocation to Value Generation
DeploymentTestingDevelpment
Before
After
Build
TestingDevelpment
DeploymentBuild
Measuring how your team's time is allocated
Saturday, April 23, 2011
LeanOps Necessities
Saturday, April 23, 2011
LeanOps Necessities
Saturday, April 23, 2011
LeanOps Necessities
Fully Automated
Infrastructure
Saturday, April 23, 2011
LeanOps Necessities
Fully Automated
Infrastructure
Test Driven
Development
Fully Automated
Infrastructure
Saturday, April 23, 2011
LeanOps Necessities
Fully Automated
Infrastructure
Test Driven
Development
Fully Automated
Infrastructure
Test Driven
Development
Continuous
Deployment
Fully Automated
Infrastructure
Saturday, April 23, 2011
LeanOps Necessities
Fully Automated
Infrastructure
Test Driven
Development
Fully Automated
Infrastructure
Test Driven
Development
Continuous
Deployment
Fully Automated
Infrastructure
Test Driven
Development
Immune
System
Continuous
Deployment
Fully Automated
Infrastructure
Saturday, April 23, 2011
LeanOps Necessities
Fully Automated
Infrastructure
Test Driven
Development
Fully Automated
Infrastructure
Test Driven
Development
Continuous
Deployment
Fully Automated
Infrastructure
Test Driven
Development
Immune
System
Continuous
Deployment
Fully Automated
Infrastructure
Test Driven
Development
Immune
System
Continuous
Deployment
Agile
Culture
Fully Automated
Infrastructure
Saturday, April 23, 2011
LeanOps Ingredients
Saturday, April 23, 2011
LeanOps Ingredients
Saturday, April 23, 2011
DevOps Examples
Saturday, April 23, 2011
•Model Driven Configuration
•Automated Deployment
•Continuous Delivery
•Built Their Own Private Cloud
• Self Service Infrastructure
• SVN, Hudson, Puppet
•Nagios, JMX, CassandraSaturday, April 23, 2011
•Agile Infrastructure
• Every Two Weeks They Re-factor Apps and Infrastructure
•Chef
Saturday, April 23, 2011
•Built a Self Service SaaS Cloud
•Chef, Puppet, Amazon, Azure, Splunk, Zookeeper, RabbitMQ
•Cloudkick
Saturday, April 23, 2011
• First Push to Production on Interview
• 50 to 100 Production Deploys per day
• Puppet, Hudson, Zookeeper, Nagios, Esper
•Behavior Driven Monitoring
• Immune System Deploys
Saturday, April 23, 2011
LeanOps Case Study
Saturday, April 23, 2011
“Very” Large Game CompanyStarted Out Small With a Cloud
Saturday, April 23, 2011
apache/phpmemcached
mysql
Dev
“Very” Large Game CompanyStarted Out Small With a Cloud
Saturday, April 23, 2011
Rightscale
AWS s3apache/phpmemcached
mysql
Dev
“Very” Large Game CompanyStarted Out Small With a Cloud
Saturday, April 23, 2011
Rightscale
AWS s3
s3putssh
apache/phpmemcached
mysql
Dev
“Very” Large Game CompanyStarted Out Small With a Cloud
Saturday, April 23, 2011
Rightscale
AWS s3
s3putssh
apache/phpmemcached
mysql
Dev
“Very” Large Game CompanyStarted Out Small With a Cloud
winning.com
Saturday, April 23, 2011
“Very” Large Game CompanyVery Fast Growth
apache/phpmemcached
mysql
Rightscale
AWS s3
winning.com
Saturday, April 23, 2011
“Very” Large Game CompanyVery Fast Growth
apache/phpmemcached
mysql
Rightscale
AWS s3
winning.com
Rightscale
AWS s3
warlock.com
apache/phpmemcached
mysql
s3put
tigerblood.com
Rightscale
AWS s3
apache/phpmemcached
mysql
s3put
ssh
Saturday, April 23, 2011
“Very” Large Game CompanyVery Fast Growth
apache/phpmemcached
mysql
Rightscale
AWS s3
winning.com
Rightscale
AWS s3
warlock.com
apache/phpmemcached
mysql
s3put
tigerblood.com
Rightscale
AWS s3
apache/phpmemcached
mysql
s3put
ssh
yuMpUppEt
3rd party
,
&middle
ware
Saturday, April 23, 2011
victims of successCOMPLAINTS
BEGAN TO MOUNT
Saturday, April 23, 2011
SOFWARE DOESN'T WORK
RIGHT !
victims of successCOMPLAINTS
BEGAN TO MOUNT
Saturday, April 23, 2011
SOFWARE DOESN'T WORK
RIGHT !
victims of successCOMPLAINTS
BEGAN TO MOUNT
MY BOXES GOT CLOBBERED !
Saturday, April 23, 2011
SOFWARE DOESN'T WORK
RIGHT !
victims of successCOMPLAINTS
BEGAN TO MOUNT
GIVE ME MY ENVIRONMENT!
MY BOXES GOT CLOBBERED !
Saturday, April 23, 2011
SOFWARE DOESN'T WORK
RIGHT !
ANOTHER DEAD MACHINE ?
victims of successCOMPLAINTS
BEGAN TO MOUNT
GIVE ME MY ENVIRONMENT!
MY BOXES GOT CLOBBERED !
Saturday, April 23, 2011
started asking questions
Saturday, April 23, 2011
people ?
started asking questions
Saturday, April 23, 2011
process?
people ?
started asking questions
Saturday, April 23, 2011
process?
people ?
started asking questions
tools ?Saturday, April 23, 2011
studio devs
middlewaredevs
NOC
systemadmins
EC2
servertemplates
yum repo
RS deploymentRS
deployment
puppet
S3
code,content
code
TARTAR
TARTAR
platform
TARRPM
TARRPM
servertemplates
EXE
AUTO
TOOLS
Provision-time builds
CONTROL
restarts
deploys
reconfigs
PROVISION RELEASE
“Very” Large Game CompanyBefore LeanOps Implementation
Saturday, April 23, 2011
“Very” Large Game CompanyAfter LeanOps Implementation
processmessaging,queuing
apache/phpmemcached
mysql
app middleware 3rd party
buildsprod
rundeck
jenkins"promote"
job
"Deploy" & "Release"job
code,content, metas
winning.com
yum
yum yum
dev
Saturday, April 23, 2011
pup
pet
SVN
active
directory
splunk
instance create
resource model
users packages
new node Node a
commands
right
scale
run
deck
hud
son
yum
repo
nag
ios
packages
sys cfg
eventslog data
agent cfg
CONTROL PROVISION RELEASE
“Very” Large Game CompanyInfrastructure as SDLC
Saturday, April 23, 2011
Ops part of the architecture
mysqlweb[server array] memcached[server array]
rundeck puppetyum
new Rightscale deployment
operations middleware tools
Saturday, April 23, 2011
How it is done• Discovery process through workshop
sessions and individual meetings
• Formal decision modeling to align strategies to business goals
• Cost-benefit analysis
• Validate against reference process architecture and Open-Source application and system provisioning tool-chain (process vs platform rationalization)
Discover
Align
Act
Saturday, April 23, 2011
Program Organization
Saturday, April 23, 2011
Program Organization
Program Management Assessment engineers
Saturday, April 23, 2011
Program Organization
Program Management Assessment engineers
Individual Interviews&
Working groups
SVPs
IT Architecture, Software Engineering, Software QA, Systems Engineering
Saturday, April 23, 2011
Program Organization
AdvisoryCommittee
Various VPs
Program Management Assessment engineers
Individual Interviews&
Working groups
SVPs
IT Architecture, Software Engineering, Software QA, Systems Engineering
Saturday, April 23, 2011
Program Organization
SponsorCIO
AdvisoryCommittee
Various VPs
Program Management Assessment engineers
Individual Interviews&
Working groups
SVPs
IT Architecture, Software Engineering, Software QA, Systems Engineering
Saturday, April 23, 2011
Priority
Saturday, April 23, 2011
Example AnalysisBottleneck
Dislocation
Inconsistency
Instability
Opacity
Rigidity
Traceability
0 3.75 7.50 11.25 15.00
Systemic Issues
Planning
Requirement
Design
Development
Build
Testing
Release
Delivery
0 5 10 15 20
Life-Cycle PhasesBusiness Scale
Control & Auth
Failure Rate
Operational Throughput
Resource Util
0 7.5 15.0 22.5 30.0
Business Issues
Consensus Raw
•8 group sessions•11 individual interviews
•133 problems identified•41 candidate strategies
Saturday, April 23, 2011
Example Strategies
Saturday, April 23, 2011
Example Prioritization/Budget Proposal
Saturday, April 23, 2011
Devops Workshop
‣ Two Day Workshop
‣ Devops and LeanOps Theory
‣ Devops Modeling
‣ Devops Team Build
‣ LeanOps Team Build
http://www.flickr.com/photos/asten/2159525309/sizes/l/
Saturday, April 23, 2011
dtosolutions.comJohn Willis
john@dtosolutions
Saturday, April 23, 2011