Ceph & OpenStack - Boston Meetup

of 22 /22
Ceph & OpenStack; Going Plaid! OpenStack Meetup | Boston, MA | 14 AUG 2013

description

Presentation materials for the Boston OpenStack meetup on 14AUG2013

Transcript of Ceph & OpenStack - Boston Meetup

Page 1: Ceph & OpenStack - Boston Meetup

Ceph & OpenStack;Going Plaid!

OpenStack Meetup | Boston, MA | 14 AUG 2013

Page 2: Ceph & OpenStack - Boston Meetup

2

•Patrick McGarry•Community monkey•Inktank / Ceph•/. > ALU > P4•@scuttlemonkey•patrick@inktankcom

Accept no substitutes

C’est Moi

Page 3: Ceph & OpenStack - Boston Meetup

3

•Ceph in <30s•Ceph & OpenStack•Distro Wars?•Orchestration•What’s Next?•Questions

The plan, Stan

Welcome!

Page 4: Ceph & OpenStack - Boston Meetup

4

On commodity hardware

Ceph can run on any infrastructure, metal or virtualized to provide a cheap and powerful storage cluster.

Object, block, and file

Low overhead doesn’t mean just hardware, it means people too!

Awesomesauce

Infrastructure-aware placement algorithm allows you to do really cool stuff.

Huge and beyond

Designed for exabyte, current implementations in the multi-petabyte. HPC, Big Data, Cloud, raw storage.

…besides wicked-awesome?

What is Ceph?

Software All-in-1 CRUSH Scale

Page 5: Ceph & OpenStack - Boston Meetup

5

Find out more!Ceph.com

…but you can find out more

Use it todayDreamhost.com/cloud/DreamObjects

Get SupportInktank.com

That WAS fast

Page 6: Ceph & OpenStack - Boston Meetup

6

Good together

OpenStack && Ceph

Page 7: Ceph & OpenStack - Boston Meetup

7

Come for the blockStay for the object and file

Cinders and Glances and …bears?

Reduced OverheadEasier to manage one cluster

“Other Stuff”Identity with Keystone, CephFS prototypes,

Gateway Drug

Page 8: Ceph & OpenStack - Boston Meetup

8

Squash HotspotsMultiple hosts = parallel workload

But what does that mean?

Instant ClonesNo time to boot for many images

Live migrationShared storage allows you to move instances between compute nodes transparently.

Blocks are delicious

Page 9: Ceph & OpenStack - Boston Meetup

9

Speak SWIFTNative support for SWIFT

And less filling!

KeystoneIntegration with identity

Horizontal ScalingEasy with HAProxy or others

Objects can juggle

Page 10: Ceph & OpenStack - Boston Meetup

10

Neat prototypesImage distribution to hypervisors

You can dress them up, but you can’t take them anywhere

Still earlyYou can fix that!

Outside usesGreat way to combine resources.

Files are tricksy

Page 11: Ceph & OpenStack - Boston Meetup

11

OBJECTS VIRTUAL DISKS FILES & DIRECTORIES

CEPHFILE SYSTEM

A distributed, scale-out filesystem with POSIX

semantics that provides storage for a legacy and

modern applications

CEPHGATEWAY

A powerful S3- and Swift-compatible gateway that brings the power of the Ceph Object Store to modern applications

CEPHBLOCK DEVICEA distributed virtual block device that delivers high-

performance, cost-effective storage for virtual machines and legacy applications

CEPH OBJECT STORE

A reliable, easy to manage, next-generation distributed objectstore that provides storage of unstructured data for applications

Page 12: Ceph & OpenStack - Boston Meetup

#DREAMCON2013

12

NOM NOM NOM

Not just a theory…

Page 13: Ceph & OpenStack - Boston Meetup

13

No incendiary devices please…

Linux Distros

Page 14: Ceph & OpenStack - Boston Meetup

14

Where the metal meets the…software

Deploying this stuff

Page 15: Ceph & OpenStack - Boston Meetup

15

Procedural, Ruby

Written in Ruby, this is more of the dev-side of DevOps. Once you get past the learning curve it’s powerful though.

Model-driven

Aimed more at the sysadmin, this procedural tool has a very wide penetration (even on Windows!).

Agentless, whole stack

Using the built-in OpenSSH in your OS, this super easy tool goes further up the stack than most.

Fast, 0MQ

Using ZeroMQ this tool is designed for massive scale and fast, fast, fast. Unfortunately 0MQ has no built in encryption.

The new hotness

Orchestration

Chef Puppet Ansible Salt

Page 16: Ceph & OpenStack - Boston Meetup

16

Canonical Unleashed

Being language agnostic, this tool can completely encapsulate a service. Can also handle provisioning all the way down to hardware.

Dell has skin in the game

Complete operations platform that can dive all the way down to BIOS/RAID level.

Others are joining in

Custom provisioning and orchestration, just one example of how busy this corner of the market is.

Doing it w/o a tool

If you prefer not to use a tool, Ceph gives you an easy way to deploy your cluster by hand.

MOAR HOTNESS

Orchestration Cont’d

Juju Crowbar ComodIT Ceph-deploy

Page 17: Ceph & OpenStack - Boston Meetup

17

This Ceph thing sounds hot.

What’s Next?

Page 18: Ceph & OpenStack - Boston Meetup

18

All about RBD!CLI -> Librbd

No, not that one…

NovaBetter boot support from Nova

BackupsIncluding incremental backups for RBD

Havana

Page 19: Ceph & OpenStack - Boston Meetup

19

Live migrationImprove Nova’s checks

Delightfully frosty

Bug FixingNew features from Havana

And you!The community does a lot to drive direction, we love input (especially when it looks like code)!

Icehouse

Page 20: Ceph & OpenStack - Boston Meetup

20

An ongoing process

While the first pass for disaster recovery is done, we want to get to built-in, world-wide replication.

Reception efficiency

Currently underway in the community!

Headed to dynamic

Can already do this in a static pool-based setup. Looking to get to a use-based migration.

Making it open-er

Been talking about it forever. The time is coming!

Hop on board!

The Ceph Train

Geo-Replication Erasure Coding Tiering Governance

Page 21: Ceph & OpenStack - Boston Meetup

21

Quarterly Online Summit

Online summit puts the core devs together with the Ceph community.

Not just for NYC

More planned, including Santa Clara and London. Keep an eye out: http://inktank.com/cephdays/

Geek-on-duty

During the week there are times when Ceph experts are available to help. Stop by oftc.net/ceph

Email makes the world go

Our mailing lists are very active, check out ceph.com for details on how to join in!

Open Source is Open!

Get Involved!

CDS Ceph Day IRC Lists

Page 22: Ceph & OpenStack - Boston Meetup

22

Comments? Anything for the good of the cause?

[email protected]

WEBSITECeph.com

SOCIAL@[email protected]/cephstorage