Automating Your Infrastructure

Automating Your Infrastructure Antons Kranga, OUG Harmony 2012, 1, June 2012

Name: Antons Kranga

Role: Technology Architect, Technology Trainer

Works: Accenture, Member of JUG Latvia

Experience: 10+ in IT, Java

Current assignment: Cloud Computing.

Problem

Copyright © 2012 Accenture All rights reserved. 4

Trends in IT

© behindthecloud.net


IT complexity and the timeline

© Mitchell Hill, Opscode,

199

0

199

1

199

2

199

3

199

4

199

5

199

6

199

7

199

8

199

9

200

0

200

1

200

2

200

3

200

4

200

5

200

6

200

7

200

8

200

9

201

0

201

1

201

2

201

3

201

4

201

51980 1981 1982 1983 1984 1985 1986 1987 1988 1989

Virtual Nodes

Physical Hardware

1980 Mainframe

1990 Client/Server

2000 Datacenter

2010+ Cloud


Managing IT Complexity

Web Servers

Application

Servers

Database



Web Servers

Application

Servers

Database

+1 server



Web Servers

Application

Servers

Database

20+ changes


Take IT Into the Cloud



Cloud gives huge

Virtualization

Power



Cloud gives huge

Virtualization

Power Power at low cost



…and Cloud

Infrastructure

Increases



Cost of change

increases

exponentially



Changes

increases

exponentially

As well as

infrastructure

complexity



How will we

manage our

infrastructure?


• Virtualization Efficiency

• Infrastructure and Configuration

Complexity

• Security, Availability etc

• Cloud Provider Lock-in

• Critical Skills Shortage

Challenges of Cloud Adoption


Example: Log Collection Becomes Complex

Example of Facebook Scribe

How to survive in the Clouds?


Why Automate?

• Scalable

Infrastructure

• Accelerate Changes

• Cloud Provider

Abstraction

• Leverage Skills

Demand

• Manage

Configuration

https://mncamr-ext.accenture.com/sites/brandspace/imagelibrary/Photographic Images/10718.jpg

https://mncamr-ext.accenture.com/sites/brandspace/imagelibrary/Photographic Images/10718.jpg


• Tight Integration with Infrastructure

• Enterprise Ready

• Write DSL (not shell commands)

• Promote Reuse

• Active Community

Configuration Management Tools

Chef Overview


Infrastructure automation platform

What is Chef?


Chef Users write Cookbooks and

Recipes to describe infrastructure in

code

What is Chef?


Anatomy of the Cookbook

Cookbook

Recipe Attributes

Configuration

Artifacts



Cookbook

Recipe Attributes

Configuration

Artifacts

Written in

Ruby DSL



Cookbook

Recipe Attributes

Configuration

Artifacts

Resource

Recipe operates

with platform

agnostic resources



Cookbook

Recipe Attributes

Configuration

Artifacts

Providers Providers

Providers

Resource

Ensures that

configuration

matches to the

platform



Cookbook

Recipe Attributes

Configuration

Artifacts

Providers Providers

Providers

Resource

Node and

cookbook

configuration

properties



Cookbook

Recipe Attributes

Configuration

Artifacts

Providers Providers

Providers

Resource

Cookbook

contain other

configuration

information



Cookbook

Recipe Attributes

Configuration

Artifacts

Providers Providers

Providers

Resource

Templates Files Libs


Chef Architecture

Chef Server

(Rest API)

Remote Node Remote Node

Remote Node

Chef Server

(private or

hosted)


Chef Architecture

Chef Server

(Rest API)


Remote Node

Chef Server

(private or

hosted)

May have

WebUI


Chef Architecture

Chef Server

(Rest API)


Remote Node

Nodes in your

infrastructure,

managed by

chef server


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

Stores all nodes

configuration

attributes,

cookbooks etc


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

All data

stored in

JSON


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

Can be used by

user or

cookbook


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

Can be used by

user or

cookbook

Provides powerful

search capabilities

for CoachDB


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Stores and

forwards data from

Chef to solr indexer


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Stores and

forwards data from

Chef to solr indexer

Updates solr

indexer


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Chef Client

All recipes has

been combined in

run list and

executed by chef

client


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Chef Client

Chef client uses

for execution “pull”

strategy which is

more flexible in

real life


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Chef Client Ohai

Ohai is the tool

to discover

platform

attributes


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Chef Client Ohai

User Workstation knife knife

knife


Chef Architecture

Chef Server

(Rest API)


Remote Node

CouchDB

cookbooks

attributes

databags

…

solr search

RabbitMQ

Chef Client Ohai

User Workstation knife knife

knife

User executes

knife CLI to

operate with Chef

Server

Questions?

Reading…

(video) Chef in 5 minutes

http://goo.gl/Of1p5 Cookbook Community

http://goo.gl/yAlPA Cookbooks from 37 Signals

http://goo.gl/uHC7A

http://goo.gl/Of1p5

http://goo.gl/Of1p5

http://goo.gl/yAlPA

http://goo.gl/yAlPA

http://goo.gl/uHC7A

http://goo.gl/uHC7A

Thank You!

Automating Your Infrastructure

Technology

Transcript of Automating Your Infrastructure