Sneak Peek: Continuent Tungsten 3.0
-
Upload
continuent -
Category
Software
-
view
174 -
download
2
description
Transcript of Sneak Peek: Continuent Tungsten 3.0
©Continuent 2014
Continuent Tungsten 3.0 Sneak Peek
Robert Hodges, CEO Ari Valtanen, VP of Products
©Continuent 2014
Continuent Tungsten 3.0 Sneak Peek
Robert Hodges, CEO Ari Valtanen, VP of Products
©Continuent 2014
Presentation Topics
• What are the big data management problems of business critical applications?
• How have Continuent products evolved to solve those problems?
• What is Continuent Tungsten 3.0 and what does it do for users?
• Wrap-up and Questions
3
©Continuent 2014
A Quick Intro to Continuent
4
• The leading provider of clustering and replication for open source DBMS
• Our Product: Continuent Tungsten
• Clustering - Commercial-grade HA, performance scaling and data management for MySQL
• Replication - Flexible, high-performance data movement
©Continuent 2014©Continuent 2014
Continuent Tungsten Customers
5
1
©Continuent 2014
Quick Continuent Facts
• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data
• Largest installation by transaction volume handles up to 8 billion transactions daily
• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop are in production now
• Amazon Redshift is the newest data warehouse target
6
©Continuent 2014 7
Data Management Needs of Business-Critical
Applications
©Continuent 2014
Business Critical MySQL Circa 2010
8
ApplicationApplicationApplications
RAIDed Storage
with BBU
No data over distance
Self-managed bare metal
servers
Home-grown management
scripts
Analytics on MySQL
©Continuent 2014
What are the big trends in the market?
• High performance transaction processing with 24x7 availability
• Data distribution across sites
• Cloud and on-premises operation
• Real-time reporting on all corporate data
9
©Continuent 2014
Growth of Analytics Capabilities
10
©Continuent 2014
Most Valuable Features According to Continuent Customers
11
Automatic Failover
Zero-Downtime Maintenance
Load Balancing
Performance
Multi-Site Ops
Disaster Recovery
Percentage of Respondents
0% 20% 40% 60% 80%
25%
29%
30%
36%
53%
72%
©Continuent 2014
Customer Growth Trends
12
Increasing Clusters
Adding Analytics
Adding Both
Percentage of Respondents
0% 10% 20% 30% 40%
14%
32%
38%
50%
©Continuent 2014
Business Critical MySQL 2014
13
ApplicationApplicationApplications
Elastic Block
Storage
Cross- Region
DR Sites
On-Demand Cloud
Instances
Puppetized Host
Management
Analytics on Hadoop Cluster
ApplicationApplicationApplications
Elastic Block
Storage
©Continuent 2014 14
Evolution of Tungsten to support business-critical
data management
©Continuent 2014
Continuent Tungsten 1.3
15
ReplicatorReplicator Replicator
Master SlaveSlave
Manager Manager Manager
Connector Connector Connector Connector
ApplicationApplication ApplicationApplication ApplicationApplication
High Availability with Read/Write Splitting
©Continuent 2014
Continuent Tungsten 1.5
16
Cross-Site Disaster Recovery
©Continuent 2014
Continuent Tungsten 2.0
17
Optimized Cloud Ops !
Parallel Replication !
Multi-Site Multi-Master
©Continuent 2014
Tungsten Replicator 2.0
18
Multi-master Heterogeneous
MySQLOracle
OracleMySQL MySQL
Fan-In
Advanced Replication Topologies
©Continuent 2014
Tungsten Replicator 3.0
19
Expanded Data Warehouse
Support
MySQL Master
Scalable row store with star schema and materialized view support
CSV files stored on HDFS with access via Hive/MapReduce
Column storage with compression and full SQL query
Amazon Redshift
©Continuent 2014 20
What is Continuent Tungsten 3.0?
©Continuent 2014
Continuent Tungsten 3.0 Features
21
Clustering Local HA Scaling
Primary/DR
Replication Advanced Topologies
Data warehouse loading
Continuent Tungsten 3.0 Certified hybrid multi-site operation
Cloud-optimized Puppet/Chef provisioning Certified HA / analytics integration
©Continuent 2014
Hybrid Multi-Master and Primary/DR
22
No app or data coupling across regions
ApplicationApplications ApplicationApplications
Amazon Region On-Premises
Live data and apps
in all regions
Clustering over AZs
Async replication between sites
Data in cloud or on-premises
OR
©Continuent 2014
Cloud-Optimized Provisioning
• Continued improvement of Puppet classes
• Addition of Chef recipes
• Dev/test install driven by Vagrant
23
(Provision Host) Step 1: Install pre-requisites Step 2: Unpack Tungsten software from RPM Step 3: Call tpm to install cluster
©Continuent 2014
Real-time Loading from Clustered MySQL to Data Warehouses
24
Tungsten Replicator
cluster1 Amazon Redshift
cluster2
©Continuent 2014
Certified Data Warehouse Loading
25
HP Vertica 6.0+
Amazon Redshift
Oracle EE/SE 10G-11G
• Bi-directional
Hadoop
• Cloudera Data Hub
• Hortonworks Data Platform
• MapR
• IBM Infosphere BigInsights
• Pivotal HD
• Apache Hadoop
©Continuent 2014
Demo
26
Transaction Processing and Analytics Integration
©Continuent 2014 27
Roadmap for Continuent Tungsten 3.0 Availability
©Continuent 2014
Roadmap for CT 3.0 release
28
• All features described here are working with anchor customers
• We are polishing integrations and improving documentation
• We are looking for 3.0 beta customers now
• Full product release will occur during Q4
©Continuent 2014 29
Future Roadmap
©Continuent 2013
Complete the Data Fabric Vision!
30
Web Application
Web Application
Proprietary RDBMS
Packaged Applications
Bridge
Bridge
Fabric Connector
Fabric Connector
OLTP Primary
Data Marts
Bridge
Bridge Hadoop Analytics
Data Streams Data Streams
Fabric Connector
Fabric Connector
Fabric Connector
OLTP DR
Bridge
SQL Column Store
Bridge
Amazon Redshift
©Continuent 2014
CT 3.0 Offers Complete Management for Business-Critical Data
• Continued 24x7 transaction processing based on economical MySQL DBMS
• Certified hybrid multi-site operation
• Cloud-optimized Puppet/Chef provisioning
• Certified HA / analytics integration
31
©Continuent 2014
www.continuent.com Follow us on Twitter @continuent
!
Tungsten Replicator: http://code.google.com/p/tungsten-replicator
Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/
560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]