The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack...
Transcript of The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack...
The State of TroveChicago Cloud Computing Meetup
April 12, 2016Amrith Kumar, CTO, Tesora
What’s this presentation about?
• What’s OpenStack
• What’s OpenStack Trove and Tesora DBaaS Platform
• What databases are supported
• What capabilities are supported
• Trove architecture
• Getting started
• Learning more
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup2
Who am I?
• A contributor to OpenStack Trove (since ~Icehouse)
– A member of the Trove core team
• Wrote the book on Trove
– Along with Doug Shelley (also of Tesora)
• Contact information
– Amrith Kumar ([email protected])
– On IRC ‘amrith’
• Catch me on #openstack-trove or #openstack-dev
– http://www.tesora.com
– For more information: [email protected]
– We’re hiring: [email protected]
• Tweet along with this presentation
– @tesoracorp
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup3
Some “warm-up” questions
• How many of you have used OpenStack?
• How many of you have used OpenStack Trove?
• What databases do you use in your company?
• How many of you have used cloud services from Amazon
– How many of you have used Amazon RDS?
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup4
Why DBaaS?
• Let’s look at some changes
– In the IT landscape
– In the application development landscape
• And how DBaaS is the emerging solution for a lot of companies
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup5
Today’s Database Challenges
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup6
“I just don’t
understand these
developers...”
“I only need it for
a couple of weeks”
“I’ll just use AWS”
“I need my
environment NOW”
“I need a NoSQL DB
for my app to scale”
“I have to release it
next month or else”
Developer IT Guy
Today’s Database Challenges
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup7
“These Ops guys don’t get it...”
“We have no idea what they are putting on the
public cloud”
“I know that they are putting our
customer data at risk”
“Why can’t they just use Oracle?”
“My budget and team aren’t
getting any bigger”
“We need time to do it right”
Developer IT Guy
A Solution: Database as a Service
• The delivery of database software &
related storage “as-a-service”
• Available on-demand, without any
hardware or software installation
or configuration
• A fully managed service maintained &
administered by the service provider
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup8
Amazon is demonstrating the importance of DBaaS
• DynamoDB was the fastest growing service in AWS history in 2012
– Werner Vogels, Amazon CTO, AWS Blog June 2012
• Redshift is now the fastest growing AWS service ever
– Werner Vogels, Amazon CTO, The Register, April 2015
• 45% of Amazon customers have implemented and are expanding use of RDS
– Jeffrey Hammond, Forrester Blog, September 2013
• AWS database business currently on a $1 billion revenue run rate
– Andy Jassy, the SVP of AWS - TechCrunch, October 2015
• Amazon’s #1 hiring focus – 84 open positions in DBaaS in November 2015
– Deutsche Bank Markets Research - NetworkWorld, November 2015
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup9
But, what if …
• You aren’t on Amazon’s cloud?
– Private cloud (in your own datacenter)
– You are a cloud service provider operating your own cloud
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup10
What is OpenStack
The OpenStack Mission: to produce the ubiquitous Open Source Cloud
Computing platform that will meet the needs of public and private
clouds regardless of size, by being simple to implement and massively
scalable.
OpenStack is open source, openly designed, openly developed by an
open community.
https://wiki.openstack.org/wiki/Main_Page
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup11
OpenStack Trove Mission Statement
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup12
The OpenStack Open Source Database as a Service Mission:
To provide scalable and reliable Cloud Database as a Service provisioning functionality for both relational and non-relational database engines, and to continue to improve its fully-featured and extensible open source framework.
https://wiki.openstack.org/wiki/Trove
What is OpenStack Trove?
• Provisioning
– Launching a new database instance
• Complex Database Topologies
– Clustering, Replication
• Automation
– Backup & Restore, Failover, Resizing, Cluster Scaling
• Multiple Database Technologies, Common API’s
– Relational, Non-Relational, … (mostly FOSS)
• Management Interface
– CLI, REST API, Web based UI
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup13
Complete Database Lifecycle Management
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup14
Manage• Manage schemas
• Create replicas for
scale & availability
• Backup/restore
Provision• On demand
• Wide DB selection
• Clusters & single
instances
Tune• Manage log files
• API’s to tune fleets of servers,
not just single instances
• Sane defaults
Secure• Automated patch management
• Users/permissions
• Restricted root access
A word about Tesora
• Tesora, the Trove company
• Leading contributor to Trove
• Makers of Tesora “DBaaS Platform”
– Enterprise product based on Trove
– Additional capabilities
– Additional datastores
– Support and Services
• Located in Boston and Toronto
– We’re hiring
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup15
OpenStack and Tesora DBaaS Platform releases
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup16
• An OpenStack release every 6 months
• A Tesora DBaaS Platform release every 3 months• One coincides with the
OpenStack release, and• One between
OpenStack releases
Next two releases
Multi-database – support for 13 different databases
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup17
SQL NoSQL
Trove in a Nutshell
• Database as a Service for OpenStack
• API’s for both development
and operations
• Self service database provisioning
• Full database lifecycle management
• Multi-database support
• Both Relational and NoSQL
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup18
A typical OpenStack Service
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup19
Some service
Service API
REST Endpoint
Component Service 2
Component Service 1
Component Service 3Persistent State
Message Bus
The Trove Architecture
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup20
Glance Storage
Guest ImageOperating System
Database Software
Trove Guest Agent
Trove
Trove API
Trove Conductor
Trove Task Manager
Nova
Cinder
Swift
Neutron
Keystone
Glance
Application
Nova Instance
Operating System
Database Software
Trove Guest Agent
Storage
The data plane and the management plane
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup21
Datastore-agnostic code in Trove
Controller and Dashboard
Datastore specific code isolated
to guest agents
Trove Multi-Datastore Architecture
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup22
Trove Controller
Trove Dashboard (Horizon)
Guest Agent
Guest Agent
Guest Agent Guest Agent
Guest Agent Guest Agent Guest Agent
Guest Agent Guest Agent
API
Task Manager
Conductor
What’s new in Mitaka
• Cassandra clustering, backup & restore, configuration groups, user
functions
• CouchDB backup and restore, user functions
• DB2 backup and restore
• Improvements to Mongo Cluster grow/shrink support
• Extend MySQL replication to include MariaDB GTID replication
• Percona XtraDB Cluster grow/shrink support, root enable
• Vertica configuration groups, cluster grow/shrink
• Improved Ceilometer notifications
• Bug fixes
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup23
What’s on deck for Newton
• Here are some projects currently under consideration
– Improvements to usability, guest image creation
– Improvements to upgrade
– Extend persistent storage to include more than Cinder/Ephemeral
– Hbase support (code is already available for review)
– Python 3 support
– Trove “Superconductor”
– Management client for Trove, use the OpenStack client
– Trove capabilities API
– Improvements in modularity between guest agent and image
– Trove v2 API
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup24
Learn More about Trove
• Trove Wiki – https://wiki.openstack.org/wiki/Trove
• Trove Source – https://git.openstack.org/cgit/openstack/trove
• On IRC - #openstack-trove
• Getting Started Videos – http://tesora.com/videos/
• Download Tesora Platform - http://tesora.com/downloads
• Trove Day
– http://tesora.com/troveday
– http://slideshare.net/tesoracorp
• LinkedIn - OpenStack Trove Group
4/12/2016Intro to OpenStack Trove & DBaaS -
Chicago Cloud Computing Meetup25
Contact information
Contact [email protected]@tesoracorp
Contact [email protected]@amrithkumarIRC: amrith
Thank You!