Ceph & OpenStack - Boston Meetup
Transcript of Ceph & OpenStack - Boston Meetup
Ceph & OpenStack;Going Plaid!
OpenStack Meetup | Boston, MA | 14 AUG 2013
•Patrick McGarry•Community monkey•Inktank / Ceph•/. > ALU > P4•@scuttlemonkey•patrick@inktankcom
Accept no substitutes
•Ceph in <30s•Ceph & OpenStack•Distro Wars?•Orchestration•What’s Next?•Questions
The plan, Stan
On commodity hardware
Ceph can run on any infrastructure, metal or virtualized to provide a cheap and powerful storage cluster.
Object, block, and file
Low overhead doesn’t mean just hardware, it means people too!
Infrastructure-aware placement algorithm allows you to do really cool stuff.
Huge and beyond
Designed for exabyte, current implementations in the multi-petabyte. HPC, Big Data, Cloud, raw storage.
What is Ceph?
Software All-in-1 CRUSH Scale
Find out more!Ceph.com
…but you can find out more
Use it todayDreamhost.com/cloud/DreamObjects
That WAS fast
OpenStack && Ceph
Come for the blockStay for the object and file
Cinders and Glances and …bears?
Reduced OverheadEasier to manage one cluster
“Other Stuff”Identity with Keystone, CephFS prototypes,
Squash HotspotsMultiple hosts = parallel workload
But what does that mean?
Instant ClonesNo time to boot for many images
Live migrationShared storage allows you to move instances between compute nodes transparently.
Blocks are delicious
Speak SWIFTNative support for SWIFT
And less filling!
KeystoneIntegration with identity
Horizontal ScalingEasy with HAProxy or others
Objects can juggle
Neat prototypesImage distribution to hypervisors
You can dress them up, but you can’t take them anywhere
Still earlyYou can fix that!
Outside usesGreat way to combine resources.
Files are tricksy
OBJECTS VIRTUAL DISKS FILES & DIRECTORIES
A distributed, scale-out filesystem with POSIX
semantics that provides storage for a legacy and
A powerful S3- and Swift-compatible gateway that brings the power of the Ceph Object Store to modern applications
CEPHBLOCK DEVICEA distributed virtual block device that delivers high-
performance, cost-effective storage for virtual machines and legacy applications
CEPH OBJECT STORE
A reliable, easy to manage, next-generation distributed objectstore that provides storage of unstructured data for applications
NOM NOM NOM
Not just a theory…
No incendiary devices please…
Where the metal meets the…software
Deploying this stuff
Written in Ruby, this is more of the dev-side of DevOps. Once you get past the learning curve it’s powerful though.
Aimed more at the sysadmin, this procedural tool has a very wide penetration (even on Windows!).
Agentless, whole stack
Using the built-in OpenSSH in your OS, this super easy tool goes further up the stack than most.
Using ZeroMQ this tool is designed for massive scale and fast, fast, fast. Unfortunately 0MQ has no built in encryption.
The new hotness
Chef Puppet Ansible Salt
Being language agnostic, this tool can completely encapsulate a service. Can also handle provisioning all the way down to hardware.
Dell has skin in the game
Complete operations platform that can dive all the way down to BIOS/RAID level.
Others are joining in
Custom provisioning and orchestration, just one example of how busy this corner of the market is.
Doing it w/o a tool
If you prefer not to use a tool, Ceph gives you an easy way to deploy your cluster by hand.
Juju Crowbar ComodIT Ceph-deploy
This Ceph thing sounds hot.
All about RBD!CLI -> Librbd
No, not that one…
NovaBetter boot support from Nova
BackupsIncluding incremental backups for RBD
Live migrationImprove Nova’s checks
Bug FixingNew features from Havana
And you!The community does a lot to drive direction, we love input (especially when it looks like code)!
An ongoing process
While the first pass for disaster recovery is done, we want to get to built-in, world-wide replication.
Currently underway in the community!
Headed to dynamic
Can already do this in a static pool-based setup. Looking to get to a use-based migration.
Making it open-er
Been talking about it forever. The time is coming!
Hop on board!
The Ceph Train
Geo-Replication Erasure Coding Tiering Governance
Quarterly Online Summit
Online summit puts the core devs together with the Ceph community.
Not just for NYC
More planned, including Santa Clara and London. Keep an eye out: http://inktank.com/cephdays/
During the week there are times when Ceph experts are available to help. Stop by oftc.net/ceph
Email makes the world go
Our mailing lists are very active, check out ceph.com for details on how to join in!
Open Source is Open!
CDS Ceph Day IRC Lists