Chef and Openstack

51
8/17/2019 Chef and Openstack http://slidepdf.com/reader/full/chef-and-openstack 1/51 OpenStack Conference Spring 2012 Matt Ray [email protected] IRC/Twitter/LP/GitHub: mattray  www.opscode.com

Transcript of Chef and Openstack

Page 1: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 1/51

OpenStack ConferenceSpring 2012

Matt [email protected]

IRC/Twitter/LP/GitHub: mattray www.opscode.com

Page 2: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 2/51

Page 3: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 3/51

Page 4: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 4/51

Application Server

Page 5: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 5/51

Application Server

Application Database

Page 6: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 6/51

Application Server

Application Databases

Page 7: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 7/51

Application Servers

Application Databases

Page 8: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 8/51

Application Servers

Application Databases

Load Balancer

Page 9: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 9/51

Application Servers

Application Databases

Load Balancers

Page 10: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 10/51

Application Servers

Application Database Cache

Load Balancers

Application Databases

Page 11: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 11/51

Application Servers

Application Database Cache

Load Balancers

Application Databases

Page 12: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 12/51

Application Servers

Application Database Cache

Load Balancers

Floating IP?

Application Databases

Page 13: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 13/51

Load Balancers

A lication Servers

NoSQL

Database Slaves

ApplicationCache

Database Cache

Database

Page 14: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 14/51

DC1

DC3

DC2

Page 15: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 15/51

http://www.flickr

Page 16: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 16/51

http://www.flickr.com/photos/louisb/4555

• Programmatiprovision and

• Treat like anybase

• Reconstruct bcode repositobackup, and resources.

Page 17: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 17/51

• Chef-Client configuratio

on nodes frorun list

• Reduce man

complexity t

abstraction• Store the con

of your prog version cont

http://www.flickr.com/photos/ssoosay/512

Page 18: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 18/51

• Networking

• Files

• Directories

• Symlinks

• Mounts

• Routes

• Users

• Groups

• Tasks

• Packages

• Software

• Services

• Configurations

• Other Stuff http://www.flickr.com/photos/stevekeys/3123167585/

Page 19: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 19/51

• Define policy

• Say what, not how

• Pull not Push

http://www.flickr.com/photos/bixentro/2591838509/

Page 20: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 20/51

extra_packages = case node['platform']  when "ubuntu","debian"  %w{  ruby1.8  ruby1.8-dev  rdoc1.8  ri1.8  libopenssl-ruby  }

  endextra_packages.each do |pkg|  package pkg do  action :install  endend

Page 21: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 21/51

•Recipes are collections ofResources

• Cookbooks containrecipes, templates, files,custom resources, etc

• Code re-use andmodularity

• Hundreds already onCommunity.opscode.com

http://www.flickr.com/ph otos/shutterhacks/4474421855/

Page 22: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 22/51

http:/

Page 23: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 23/51

Page 24: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 24/51

Page 25: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 25/51

 Jboss A

Memcache

Postgres Slaves

Postgres Master

NagiosGraphite

Page 26: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 26/51

 Jboss A

Memcache

Postgres Slaves

Postgres Master

NagiosGraphite

Page 27: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 27/51

 

 Jboss A

Memcache

Postgres Slaves

Postgres Master

NagiosGraphite

Page 28: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 28/51

 

NagiosGraphite

 Jboss App

Memcache

Postgres Slaves

• 12+ resource changes for 1 node addition

Page 29: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 29/51

• Simple internal applic

• Complex external app

• Workstations

• Hadoop clusters

• IaaS infrastructure

• PaaS infrastructure

• SaaS applications

• Storage systems

•  You name it

http://www.flickr.com/photos/hyku/245010680/

Page 30: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 30/51

http://www.flickr.com/photos/helico/404640681/

•  Automatically

reconfigure

everything• Linux, Windows,

Unixes, BSDs

• Load balancers

•Metrics collectionsystems

• Monitoring systems

• Cloud migrations

become trivial

Page 31: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 31/51

•  Apache License, Version 2.0

• 675+ Individual contributors

• 125+ Corporate contributors

• Dell, Rackspace, VMware, DreamHost,

 Joyent, Heroku, RightScale, DeutscheTelekom and many more

• 450+ cookbooks

• http://community.opscode.com

Page 32: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 32/51

Page 34: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 34/51

• TryStack.org, NTT & others

• Smokestack testing

• Xen & PostgreSQL

•  Apache 2 license

• #trystack on irc.freenode.org & Facebook

• github.com/openstack/openstack-chef 

Page 35: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 35/51

• Rackspace, DreamHost, Opscode & others

• KVM & MySQL on Ubuntu 12.04 (others)

•  Apache 2 license

• #openstack-chef on irc.freenode.net

• github.com/osops/

• monitoring, logging, operations tools

• github.com/rcbops/chef-cookbooks

Page 36: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 36/51

• Datacenter installer from Dell

• Extension of the Chef server

• "Barclamps" contain cookbooks + more

• Dell released under the Apache 2 license

• Dell, enStratus, Opscode & many others

• Mailing list and Skype

• github.com/dellcloudedge/crowbar

Page 37: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 37/51

• Chef ties it all together automatically

• Scaling changes how we deploy

• Interchangeable components

• Configurations shared, supported &documented

• Licensing makes it available to everyone

Page 38: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 38/51

Page 39: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 39/51

$ knife openstackAvailable openstack subcommands: (for detailsCOMMAND --help)

** OPENSTACK COMMANDS **knife openstack flavor list (options)

knife openstack image list (options)knife openstack server create (options)knife openstack server delete SERVER [SERVER]knife openstack server list (options)

Page 40: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 40/51

$ knife openstack flavor listID Name Virtual CPUs RAM Disk1 m1.tiny 1 512 MB 0 GB2 m1.small 1 2048 MB 20 GB3 m1.medium 2 4096 MB 40 GB

4 m1.large 4 8192 MB 80 GB5 m1.xlarge 8 16384 MB 160 GB

Page 41: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 41/51

$ knife openstack image listID Name13 natty-server-cloudimg-amd6412 natty-server-cloudimg-amd64-kernel15 oneiric-server-cloudimg-amd64

14 oneiric-server-cloudimg-amd64-kernel

Page 42: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 42/51

knife openstack server create --node-name ko1 --flavor 1 --image

Page 43: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 43/51

Page 44: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 44/51

$ ssh -i ~/.ssh/trystack.pem [email protected] authenticity of host '8.21.28.24 (8.21.28.24)' can't be established.RSA key fingerprint is 0c:d8:3e:34:d1:de:c4:ee:5f:bc:b5:89:11:0d:73:e0.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added '8.21.28.24' (RSA) to the list of known hosts.Welcome to Ubuntu 11.04 (GNU/Linux 2.6.38-13-virtual x86_64)

 * Documentation: https://help.ubuntu.com/

  System information as of Thu Feb 16 23:43:29 UTC 2012

  System load: 0.08 Processes: 63  Usage of /: 40.8% of 1.35GB Users logged in: 0  Memory usage: 6% IP address for eth0: 8.21.28.24  Swap usage: 0%---------------------------------------------------------------------<snip>Get cloud support with Ubuntu Advantage Cloud Guest

  http://www.ubuntu.com/business/services/cloud

The programs included with the Ubuntu system are free software;the exact distribution terms for each program are described in theindividual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted byapplicable law.

To run a command as administrator (user "root"), use "sudo <command>".See "man sudo_root" for details.

ubuntu@ko1:~$

Page 45: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 45/51

• knife ec2

• knife rackspace

• knife hp

• knife openstack

• ... and many others

Page 46: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 46/51

http://www.flickr.com/photos/felixmorgner/4347750467/ 

Page 47: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 47/51

• http://wiki.opscode.com/display/chef/OpenStack+Bootstrap+Fast+Start+Guide

• Merges & publish on rubygems.org

•Testing with Essex

• tickets.opscode.com/browse/KNIFE _OPENSTACK

Page 48: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 48/51

• Chef 0.10.10

• Full Stack installer

• Linux, BSDs, OSX, Solaris (Illumos),Windows

• Chef 11

• Reporting

• Dry Run

Page 49: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 49/51

•  Additional Hypervisors

• More Databases

• Operations Support

•HA Configuration

•  Additional Operating Systems

• Folsom (Quantum, Melange, etc.)

Page 50: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 50/51

• Collaborate with the Community

• Reference cookbooks for Essex

• OpenStack Quick Start tutorial

• Refresh Deploying OpenStack with Chef

• Knife OpenStack enhancements

Page 51: Chef and Openstack

8/17/2019 Chef and Openstack

http://slidepdf.com/reader/full/chef-and-openstack 51/51

Matt [email protected]

IRC/Twitter/LP/GitHub: mattray www.opscode.com