Chef for OpenStack

NYC Chef for OpenStack Hack DayJanuary 24, 2013

Matt RaySenior Technical EvangelistOpscode

Friday, January 25, 13

Hack Day Agenda

• Introductions

• Overview & Status of Chef for OpenStack

• Lunch?

• Deep dive topics

• Capture Progress and Roadmap

Friday, January 25, 13

Potential Hack Day Topics

• Essex code walk-through

• Folsom code navigating

• Prerequisites documentation (OS, network)

• Using Test-Kitchen with OpenStack

• Swift cookbook start

• Hyper-V

• RHEL/SUSE support

• openstack-commons vs. osops-utils

• knife-openstack

• OpenStack-Syslog/Monitoring Resource Providers

• Testing with desktop virtualization

• Technical Debt!

• Building a CI Toolchain

• Build from Source

• Quantum & Networking

Friday, January 25, 13

Overview & Status of Chef for OpenStack

Friday, January 25, 13

Chef for OpenStack: Who

Friday, January 25, 13

Chef for OpenStack: Why

• Community for the automated deployment and management of OpenStack

• Reduce fragmentation and encourage collaboration

• Deploying OpenStack is not "secret sauce"

• Project not a product

• Apache 2 license

Friday, January 25, 13

Chef for OpenStack: What

• Chef Repository for Deploying OpenStack

• Documentation for Chef for OpenStack

• Cookbooks• Keystone

• Glance

• Nova

• Horizon

• Swift

• Quantum

• Cinder

• knife-openstackFriday, January 25, 13

Chef for OpenStack: Where

• groups.google.com/group/opscode-chef-openstack

• #openstack-chef on irc.freenode.net

• github.com/opscode/openstack-chef-repo

• github.com/mattray/openstack-chef-docs

• github.com/opscode-cookbooks/

• keystone, glance, nova, horizon, swift,quantum,cinder

• github.com/opscode/knife-openstack

• @chefopenstack

Friday, January 25, 13

• Chef repo for Essex (2012.1.1 tag)

• Operating Systems (Ubuntu 12.04)

• Hypervisors (KVM, LXC)

• Databases (MySQL)

• FlatDHCP HA & VLAN networking

• manual floating IPs documented

• Test Kitchen integration

Chef for OpenStack: When (Today)

Friday, January 25, 13

Chef for OpenStack: When (Tomorrow)

• Documentation (docs.opscode.com)

• Folsom is under active development

• AT&T, DreamHost and Rackspace have active branches of shared codebase

• Moving to openstack-common

• Cinder (lvm, Netapp)

• Quantum (Nicira with Open vSwitch)

Friday, January 25, 13

• Documentation (docs.opscode.com)

• Grizzly & trunk(!?)

• Cinder (Ceph)

• Quantum (Midokura)

• Hypervisors (Hyper-V, bare metal)

• Databases (PostgreSQL)

• Operating Systems (RHEL, Debian, SUSE)

• HA Configurations

Chef for OpenStack When: (Roadmap)

Friday, January 25, 13

github.com/mattray/openstack-chef-docsmoving to

github.com/opscode/chef-docs

Chef for OpenStack: How

Friday, January 25, 13

knife openstack

Friday, January 25, 13

knife openstack

$ knife openstackAvailable openstack subcommands: (for details, knife SUB-COMMAND --help)

** OPENSTACK COMMANDS **knife openstack flavor list (options)knife openstack image list (options)knife openstack server create (options)knife openstack server delete SERVER [SERVER] (options)knife openstack server list (options)

Friday, January 25, 13

knife openstack flavor list

$ knife openstack flavor listID Name Virtual CPUs RAM Disk 1 m1.tiny 1 512 MB 0 GB 2 m1.small 1 2048 MB 10 GB3 m1.medium 2 4096 MB 10 GB4 m1.large 4 8192 MB 10 GB5 m1.xlarge 8 16384 MB 10 GB

Friday, January 25, 13

knife openstack image list

$ knife openstack image listID Name 4a197431-503d-4b85-b61e-84af21ca8654 cirros-image f8ebb842-c0c0-4be3-8c4c-f72f48edec50 precise-image

Friday, January 25, 13

knife openstack server create -a -f 1 -I f8ebb842-c0c0-4be3-8c4c-f72f48edec50\ -S local -i ~/.ssh/local.pem -x ubuntu

knife openstack server create

Friday, January 25, 13

Friday, January 25, 13

Friday, January 25, 13

knife-openstack compatibility

• Uses the OpenStack API

• Diablo, Essex, Folsom

• Cloudscaling

• Crowbar

• DreamHost

• Nebula

• Piston

• Rackspace

Friday, January 25, 13

knife-openstack Roadmap

• docs.opscode.com/plugin_knife_openstack.html

• tickets.opscode.com/browse/KNIFE/component/

• security groups missing

• floating IP address management

• quantum network features to add?

Friday, January 25, 13

Chef for Infrastructure Portability

• knife openstack

• Crowbar, DreamHost, Piston, TryStack

• knife hp

• knife rackspace

• knife ec2

• ... and many others

Friday, January 25, 13

ResourcesChef for OpenStackEcosystem

Friday, January 25, 13

Deploying OpenStack

• Chef ties it all together automatically

• Scaling changes how we deploy

• Interchangeable components

• Configurations shared, supported & documented

• Licensing makes it available to everyone

Friday, January 25, 13

Essex Contributors

• AT&T

• Calxeda

• Dell

• DreamHost

• Opscode

• Rackspace

• Webtrends

Friday, January 25, 13

AT&T

• github.com/att-cloud/

• primary Folsom merge source

• openstack-common

• cinder (lvm, netapp, rbd)

• lots of support cookbooks

Friday, January 25, 13

openstack-common cookbook

• Common setup recipes and attributes describing OpenStack deployment.

• Libraries for endpoints, databases, encrypted data bags and passwords

• replacement for osops-utils

• github.com/att-cloud/cookbook-openstack-common

Friday, January 25, 13

Crowbar

• Hardware provisioning and application management platform

• github.com/crowbar/

• Dell, SUSE, others

• likely Swift cookbook source combined with Rackspace's

Friday, January 25, 13

DreamHost

• github.com/dreamhost

• ceph

• ceilometer

Friday, January 25, 13

Rackspace

• Private Cloud: Alamo

• github.com/rcbops/chef-cookbooks

• www.rackspace.com/cloud/private/

• primary Essex merge source

• likely Quantum and Red Hat source

Friday, January 25, 13

• Cookbooks reusable outside of OpenStack

• Test Kitchen

• Berkshelf & Librarian

• Spiceweasel

• knife-rackspace/hp/dreamhost

• Crowbar, pxe_dust & Razor

• Arista EOS cookbook

Chef for OpenStack "Halo Effect"

Friday, January 25, 13

• Nicira NVP cookbook

• Open vSwitch cookbook

• Development in progress by Opscode

• Will be open sourced

Nicira Cookbook

Friday, January 25, 13

• Cookbook to tune performance of Intel

• CPUs

• Motherboards

• Networking

• SSDs

• Development in progress by Opscode

• github.com/mattray/intel-cookbook

Intel Cookbook

Friday, January 25, 13

Chef for OpenStack TL;DL

• Opscode.com/openstack

• Project, not a product

• Lots of contributors with real deployments

• Essex works, Folsom merging

• Features driven by demand (show up for what you want)

• Documentation with examples

Friday, January 25, 13

http://www.flickr.com/photos/16339684@N00/2681435235/

An Evolving Project

Let's have aHack Day!

Friday, January 25, 13

Potential Hack Day Topics

• Essex code walk-through

• Folsom code navigating

• Prerequisites documentation (OS, network)

• Using Test-Kitchen with OpenStack

• Swift cookbook start

• Hyper-V

• RHEL/SUSE support

• openstack-commons vs. osops-utils

• knife-openstack

• OpenStack-Syslog/Monitoring Resource Providers

• Testing with desktop virtualization

• Technical Debt!

• Building a CI Toolchain

• Build from Source

• Quantum & Networking

Friday, January 25, 13

Questions?

Matt Raymatt@opscode.comTwitter|GitHub|IRC: mattray

Friday, January 25, 13