Sneak Peek: Continuent Tungsten 3.0

32
©Continuent 2014 Continuent Tungsten 3.0 Sneak Peek Robert Hodges, CEO Ari Valtanen, VP of Products

description

Get a preview of the next advance in data management technology! Continuent Tungsten 3.0 brings the power of advanced clustering and replication to offer data management needs for your entire business including MySQL high availability, disaster recovery, multi-master operation, and real-time data warehouse loading. With Continuent Tungsten you can apply the full power not just of MySQL but all your data management systems, including Hadoop, Oracle and Amazon Redshift, to deliver complete transaction processing and analytics for your business. Continuent Tungsten 3.0 enables high-performance, always-on access to data, combined with the ability to process transactions over multiple sites while tightly integrating transaction processing with analytics. Continuent Tungsten 3.0 builds on the solid reliability of Continuent's already proven Tungsten 2.0 clusters to offer complete integration with our latest replication technologies into a single certified, well-documented and easy-to-manage solution. Join us for a sneak peek including demos of: - Robust multi-master operation between Continuent Tungsten clusters to enable active data management on multiple sites - Efficient Puppet- and Chef-based installation tools for rapid provisioning of clustering and replication in cloud as well as on-premises environments - Real-time replication from highly available Continuent Tungsten MySQL database clusters to Hadoop, Oracle, Amazon Redshift, and HP Vertica to enable rapid propagation of transaction data into analytic reports.

Transcript of Sneak Peek: Continuent Tungsten 3.0

Page 1: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 3.0 Sneak Peek

Robert Hodges, CEO Ari Valtanen, VP of Products

Page 2: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 3.0 Sneak Peek

Robert Hodges, CEO Ari Valtanen, VP of Products

Page 3: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Presentation Topics

• What are the big data management problems of business critical applications?

• How have Continuent products evolved to solve those problems?

• What is Continuent Tungsten 3.0 and what does it do for users?

• Wrap-up and Questions

3

Page 4: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

A Quick Intro to Continuent

4

• The leading provider of clustering and replication for open source DBMS

• Our Product: Continuent Tungsten

• Clustering - Commercial-grade HA, performance scaling and data management for MySQL

• Replication - Flexible, high-performance data movement

Page 5: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014©Continuent 2014

Continuent Tungsten Customers

5

1

Page 6: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Quick Continuent Facts

• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data

• Largest installation by transaction volume handles up to 8 billion transactions daily

• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop are in production now

• Amazon Redshift is the newest data warehouse target

6

Page 7: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014 7

Data Management Needs of Business-Critical

Applications

Page 8: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Business Critical MySQL Circa 2010

8

ApplicationApplicationApplications

RAIDed Storage

with BBU

No data over distance

Self-managed bare metal

servers

Home-grown management

scripts

Analytics on MySQL

Page 9: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

What are the big trends in the market?

• High performance transaction processing with 24x7 availability

• Data distribution across sites

• Cloud and on-premises operation

• Real-time reporting on all corporate data

9

Page 10: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Growth of Analytics Capabilities

10

Page 11: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Most Valuable Features According to Continuent Customers

11

Automatic Failover

Zero-Downtime Maintenance

Load Balancing

Performance

Multi-Site Ops

Disaster Recovery

Percentage of Respondents

0% 20% 40% 60% 80%

25%

29%

30%

36%

53%

72%

Page 12: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Customer Growth Trends

12

Increasing Clusters

Adding Analytics

Adding Both

Percentage of Respondents

0% 10% 20% 30% 40%

14%

32%

38%

50%

Page 13: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Business Critical MySQL 2014

13

ApplicationApplicationApplications

Elastic Block

Storage

Cross- Region

DR Sites

On-Demand Cloud

Instances

Puppetized Host

Management

Analytics on Hadoop Cluster

ApplicationApplicationApplications

Elastic Block

Storage

Page 14: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014 14

Evolution of Tungsten to support business-critical

data management

Page 15: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 1.3

15

ReplicatorReplicator Replicator

Master SlaveSlave

Manager Manager Manager

Connector Connector Connector Connector

ApplicationApplication ApplicationApplication ApplicationApplication

High Availability with Read/Write Splitting

Page 16: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 1.5

16

Cross-Site Disaster Recovery

Page 17: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 2.0

17

Optimized Cloud Ops !

Parallel Replication !

Multi-Site Multi-Master

Page 18: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Tungsten Replicator 2.0

18

Multi-master Heterogeneous

MySQLOracle

OracleMySQL MySQL

Fan-In

Advanced Replication Topologies

Page 19: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Tungsten Replicator 3.0

19

Expanded Data Warehouse

Support

MySQL Master

Scalable row store with star schema and materialized view support

CSV files stored on HDFS with access via Hive/MapReduce

Column storage with compression and full SQL query

Amazon Redshift

Page 20: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014 20

What is Continuent Tungsten 3.0?

Page 21: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 3.0 Features

21

Clustering Local HA Scaling

Primary/DR

Replication Advanced Topologies

Data warehouse loading

Continuent Tungsten 3.0 Certified hybrid multi-site operation

Cloud-optimized Puppet/Chef provisioning Certified HA / analytics integration

Page 22: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Hybrid Multi-Master and Primary/DR

22

No app or data coupling across regions

ApplicationApplications ApplicationApplications

Amazon Region On-Premises

Live data and apps

in all regions

Clustering over AZs

Async replication between sites

Data in cloud or on-premises

OR

Page 23: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Cloud-Optimized Provisioning

• Continued improvement of Puppet classes

• Addition of Chef recipes

• Dev/test install driven by Vagrant

23

(Provision Host) Step 1: Install pre-requisites Step 2: Unpack Tungsten software from RPM Step 3: Call tpm to install cluster

Page 24: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Real-time Loading from Clustered MySQL to Data Warehouses

24

Tungsten Replicator

cluster1 Amazon Redshift

cluster2

Page 25: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Certified Data Warehouse Loading

25

HP Vertica 6.0+

Amazon Redshift

Oracle EE/SE 10G-11G

• Bi-directional

Hadoop

• Cloudera Data Hub

• Hortonworks Data Platform

• MapR

• IBM Infosphere BigInsights

• Pivotal HD

• Apache Hadoop

Page 26: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Demo

26

Transaction Processing and Analytics Integration

Page 27: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014 27

Roadmap for Continuent Tungsten 3.0 Availability

Page 28: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Roadmap for CT 3.0 release

28

• All features described here are working with anchor customers

• We are polishing integrations and improving documentation

• We are looking for 3.0 beta customers now

• Full product release will occur during Q4

Page 29: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014 29

Future Roadmap

Page 30: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2013

Complete the Data Fabric Vision!

30

Web Application

Web Application

Proprietary RDBMS

Packaged Applications

Bridge

Bridge

Fabric Connector

Fabric Connector

OLTP Primary

Data Marts

Bridge

Bridge Hadoop Analytics

Data Streams Data Streams

Fabric Connector

Fabric Connector

Fabric Connector

OLTP DR

Bridge

SQL Column Store

Bridge

Amazon Redshift

Page 31: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

CT 3.0 Offers Complete Management for Business-Critical Data

• Continued 24x7 transaction processing based on economical MySQL DBMS

• Certified hybrid multi-site operation

• Cloud-optimized Puppet/Chef provisioning

• Certified HA / analytics integration

31

Page 32: Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

www.continuent.com Follow us on Twitter @continuent

!

Tungsten Replicator: http://code.google.com/p/tungsten-replicator

Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]