Config managament for development environments ii

gareth rushgrove | morethanseven.net

Configuration Managementfor Development Environments

LRUG 8th August 2011

http://www.flickr.com/photos/36144637@N00/159627088/



Gareth Rushgrove


Blog at morethanseven.net


Curate devopsweekly.com


http://www.flickr.com/photos/iancarroll/5027441664gareth rushgrove | morethanseven.net

Problems

http://www.flickr.com/photos/iancarroll/5027441664

http://www.flickr.com/photos/iancarroll/5027441664

http://www.flickr.com/photos/34652102@N04/5059217055gareth rushgrove | morethanseven.net

1. Not all developers want to be sysadmins

http://www.flickr.com/photos/34652102@N04/5059217055


http://www.flickr.com/photos/34652102@N04/5059824808gareth rushgrove | morethanseven.net

2. New team members getting started time



http://www.flickr.com/photos/biggreymare

3. Running a full set of services locally




4. Works on my machine


⚡ brew info mysqlmysql 5.5.14

$ aptitude show mysql-serverPackage: mysql-serverState: not installedVersion: 5.1.41-3ubuntu12.10

Homebrew is great but...


What’s a few versions between friends?


- An ORDER BY clause was bound to the incorrect substatement when used in UNION context.

- A NOT IN predicate with a subquery containing a HAVING clause could retrieve too many rows, when the subquery itself returned NULL.

- MIN(year_col) could return an incorrect result in some cases.

23 releases and 21 months in-between 5.1.41 and 5.5.14. Here’s some fixed bugs:

And lots more

Spot the cross platform bug (not the security flaw)


⚡ ./server.rb &⚡ curl "http://127.0.0.1:8181/?query=Bob"⚡ curl "http://127.0.0.1:8181/?query=bob"⚡ lsBob⚡ cat BobHello bob

On our Mac


http://127.0.0.1:8181/?query=Bob

http://127.0.0.1:8181/?query=Bob

http://127.0.0.1:8181/?query=bob

http://127.0.0.1:8181/?query=bob

$ ./server.rb &$ curl "http://127.0.0.1:8181/?query=Bob"$ curl "http://127.0.0.1:8181/?query=bob"$ lsBob bob$ cat BobHello Bob$ cat bobHello bob

On Linux


http://127.0.0.1:8181/?query=Bob

http://127.0.0.1:8181/?query=Bob

http://127.0.0.1:8181/?query=bob

http://127.0.0.1:8181/?query=bob

gareth rushgrove | morethanseven.net http://www.flickr.com/photos/34652102@N04/5059208501

Solutions



http://www.flickr.com/photos/dawilson/2598713027

Virtualisation




VirtualBox


VMware


Virtualisation needs powerful hardware

gareth rushgrove | morethanseven.net http://www.flickr.com/photos/martinoc/477335951

http://flickr.com/photos/psd/102332391/


gareth rushgrove | morethanseven.net http://www.flickr.com/photos/peteradams/2272928740

What about editing code?

http://www.flickr.com/photos/peteradams/2272928740

http://www.flickr.com/photos/peteradams/2272928740


Shared Folders or NFS




Doubledown

Vim


Vagrantup.com


What is Vagrant?


- Automated virtual machine creation using Oracle’s VirtualBox- Automated provisioning of virtual environments using Chef or Puppet- Full SSH access to created environments- Assign a static IP to your VM, accessible from your machine- Forward ports to the host machine- Shared folders allows you to continue using your own editor- Package environments into distributable boxes- Completely tear down environment when you’re done- Easily rebuild a complete environment with a single command


Base boxes




VeeWee



Community boxes

⚡ gem install vagrant⚡ vagrant box add lucid32 http://.../lucid32.box⚡ vagrant init⚡ vagrant up

Vagrant up


http://files.vagrantup.com/lucid32.box

http://files.vagrantup.com/lucid32.box

⚡ lsVagrantfile⚡ vagrant up⚡ vagrant ssh⚡ vagrant reload⚡ vagrant halt⚡ vagrant destroy

Vagrant command line


⚡ vagrant ssh-configHost default HostName 127.0.0.1 User vagrant Port 2222 IdentityFile /Users/.../vagrant-0.8.2/keys/vagrant ...

Export SSH configuration


Vagrant::Config.run do |config| config.vm.box = "lucid32"end

Vagrantfile


Vagrant::Config.run do |config| config.vm.forward_port("web", 80, 8080) config.vm.forward_port("ftp", 21, 4567) config.vm.forward_port("ssh", 22, 2222, :auto => true)end

Port forwarding


Vagrant::Config.run do |config| config.vm.share_folder("folder", "/guest", "../host")end

Shared folders


Vagrant::Config.run do |config| config.vm.boot_mode = :gui config.ssh.forward_agent = true config.vm.customize do |vm| vm.memory_size = 512 endend

Lots more options


Puppet


Vagrant provisioning with Puppet


Vagrant::Config.run do |config| config.vm.provision :puppet do |puppet| puppet.manifests_path = "puppetmanifests" puppet.manifest_file = "newbox.pp" endend

Chef


Vagrant provisioning with Chef


Vagrant::Config.run do |config| config.vm.provision :chef_solo do |chef| chef.add_recipe = "garethr" chef.cookbooks_path = “cookbooks” endend

Specifying Chef roles


Vagrant::Config.run do |config| config.vm.provision :chef_solo do |chef| chef.roles_path = "roles" chef.add_role("vm") endend

Vagrant::Config.run do |config| config.vm.provision :chef_solo do |chef| chef.recipe_url = "http://github.com/cookbooks.tar.gz" chef.add_recipe "garethr" chef.cookbooks_path = [:vm, "cookbooks"] chef.json.merge!({ :garethr => { :ohmyzsh => "https://github.com/.../oh-my-zsh.git", :dotvim => "https://github.com/garethr/dotvim.git" }}) endend


Remote file

http://cloud.github.com/downloads/garethr/chef-repo/cookbooks.tar.gz

http://cloud.github.com/downloads/garethr/chef-repo/cookbooks.tar.gz

https://github.com/garethr/oh-my-zsh.git

https://github.com/garethr/oh-my-zsh.git

https://github.com/garethr/dotvim.git

https://github.com/garethr/dotvim.git

http://www.flickr.com/photos/s3a/4710416678

Plugins


- Vagrant Hosts - https://github.com/dwt/vagrant-hosts- Sahara - https://github.com/jedi4ever/sahara- Vagrantboxes - https://github.com/garethr/ruby-vagrantboxes



http://www.flickr.com/photos/crustyscumbrothersontour/2674351601

Local configuration management





Real world example

gareth rushgrove | morethanseven.netgareth rushgrove | morethanseven.net

- I want my development environment everywhere- I don’t want a wiki page of instructions- I don’t want to have to manually install everything- I don’t want to care about destroying a virtual machine- So I have a simple Chef cookbook to bootstrap my machines

⚡ cd /m/somefolder⚡ tree├── Vagrantfile└── cookbooks └── garethr ├── attributes │ └── default.rb ├── files │ └── default │ └── zshrc └── recipes └── default.rb

Chef cookbook layout


Packages I like


%w{zsh wget curl lynxgit-core ack-grep vim-noxdvtm build-essential tree}.each do |pkg| package pkg do action :install endend

My shell configs


git "/home/vagrant/.oh-my-zsh" do repository node[:garethr][:ohmyzsh] action :checkout user "vagrant" group "vagrant"end

cookbook_file "/home/vagrant/.zshrc" do source "zshrc" owner "vagrant" group "vagrant"end

Attributes


default[:garethr][:dotvim] = "https://github.com/carlhuda/janus.git"

default[:garethr][:ohmyzsh] = "https://github.com/robbyrussell/oh-my-zsh.git"

https://github.com/jtimberman/dotvim.git

https://github.com/jtimberman/dotvim.git

https://github.com/robbyrussell/oh-my-zsh.git

https://github.com/robbyrussell/oh-my-zsh.git

My Vim configs


git "/home/vagrant/.vim" do repository node[:garethr][:dotvim] action :checkout user "vagrant"end

execute "build janus" do command "rake" user "vagrant" cwd "/home/vagrant/.vim" environment ({'HOME' => '/home/vagrant'}) creates "/home/vagrant/.vimrc"end

Testing with ChefSpec


require "chefspec"

describe "garethr" do before(:all) do @chef_run = ChefSpec::ChefRunner.new @chef_run.converge "garethr" end

it "should install zsh" do @chef_run.should install_package "zsh" endend


Awesome things I ignored


- The Chef Server- Roles and Environments- Knife and Shef- Splitting the one file into multiple cookbooks- Managing running services- Simplifying cookbooks by creating system packages- Supporting different operating systems- The Chef architecture- Testing with Cucumber-Chef


Conclusions


- Using Virtualisation catches bugs early- Using Vagrant makes using virtual machines pleasurable- Storing configuration as code makes it shareable- Able to apply development best practice to dev environments

More information


- IRC - #vagrant on Freenode- Github Issues - https://github.com/mitchellh/vagrant/issues- Google Groups - http://groups.google.com/group/vagrant-up

https://github.com/mitchellh/vagrant/issues

https://github.com/mitchellh/vagrant/issues

http://groups.google.com/group/vagrant-up

http://groups.google.com/group/vagrant-up

Questions?

gareth rushgrove | morethanseven.net http://flickr.com/photos/psd/102332391/



Config managament for development environments ii

Technology

Transcript of Config managament for development environments ii