MySQL conference 2010 ignite talk on InfiniDB

Post on 10-Jun-2015

1.845 views 2 download

Tags:

Transcript of MySQL conference 2010 ignite talk on InfiniDB

Robin SchumacherVP Products

Calpont

Calpont’s InfiniDB

Who the Heck are

We…?

InfiniDB by Calpont is…

A column-oriented database engine A great option for analytics, data warehousing, and read-intensive apps A scale up and out design that future proofs your systems

InfiniDB scales up…It will address all the CPU’s/cores on your machine.

SSB Query (@100 scale)

InfiniDB 1 Core(elapsed time in

seconds)

InfiniDB 8 cores

(elapsed time in seconds)

Overall Percent

Reduction with

additional cores

Q2.1 210.21 44.65 79%

Q2.2 151.20 19.70 87%

Q2.3 121.33 15.94 87%

Q3.1 316.79 55.04 83%

Q3.2 164.12 22.14 87%InfiniDB runs great on a single machine as well as on multiple boxes.

InfiniDB scales out…It does MPP across multiple nodes, with auto-failover.

SSB Query@1000

1 PM(elapsed time in seconds)

2 PM(elapsed time in seconds)

4 PM(elapsed time in seconds)

8 PM(elapsed time in seconds)

Overall Percent Reduction from

1 – 8 PM’s

Q2.1 531.34 261.35 129.90 68.21 87%

Q2.2 430.25 214.87 106.37 56.41 87%

Q2.3 386.66 192.03 96.03 51.36 87%

Q3.1 848.79 425.25 316.50 134.21 84%

Q3.2 597.97 297.46 148.49 77.74 87%

PM = Performance Module, which handles I/O operations for InfiniDB

InfiniDB has…Plenty of features to support demanding environments• MySQL front end

• Column-oriented• Multi-Terabyte database capable• High-Speed bulk loader w/ no blocking queries while

loading• Crash-recovery• Transaction support (ACID compliant)• INSERT/UPDATE/DELETE (DML) support• No indexing necessary• Automatic partitioning of data• Hash joins• MVCC support – snapshot read (readers don’t block

writers)• Alter Table with online add column capability • High concurrency supported• Logical data compression• Multi-Node, MPP scale out capable w/ failover• GPL and Commercial EditionsInfiniDB is designed for fast load and query performance

How Fast…?

InfiniDB vs. “Leading” Row DatabaseInfiniDB takes up 22% less space InfiniDB loaded data 22% faster

InfiniDB total query times were 65% less InfiniDB average query times were 59% less

Notice not only are

the queries faster, but also more

predictable

* Tests run on standalone machine: 16 CPU, 16GB RAM, CentOS 5.4 with 2TB of raw data

Percona’s Test of Open Source Column Databases

610 GB of raw data; 8 Core Machinehttp://www.mysqlperformanceblog.com/2010/01/07/star-schema-bechmark-infobright-infinidb-and-luciddb/

(lower is better)

Internal MPP Stress Test using SSB Benchmark

Six Performance Modules against data size of Percona tests and then 10x the size. Shows predictable performance, MPP linear speed gains over standalone implmentation, and capabilities

that other open source databases don’t have.http://www.infinidb.org/infinidb-blog/mysql-parallel-query-processing-of-60-billion-rows-via-infinidb.html

Predictable Performance with More Data

What else should I know…?

Connectors and More…From a dev perspective, use InfiniDB as you would standard MySQL

All connectors, tools, dev IDE’s, etc., should work fine with InfiniDB

Use InfiniDB & Other Engines…

Other MySQL engines can be used with InfiniDB in the same database/instance

Use InfiniDB & Other Engines…

Other engines can also be used with InfiniDB in an MPP fashion

Our Commitment…

1.0 now available for all

Release early/often with monthly maintenance updates for Community Go where the Community and Customers send us

What is coming next…?

Coming Attractions for InfiniDB…

July 2010: InfiniDB 1.1High-speed subqueries, UTF8, Windows port, and more.

December 2010: InfiniDB 1.5-2.0Shared nothing support, physical compression, and more.

2011: InfiniDB 2.x-3.xYou tell us…!

How can I get it…?

• Download InfiniDB Community Edition• Download/View Free InfiniDB documentation• Read InfiniDB technical white papers and articles• Read InfiniDB intro articles on MySQL dev zone• Visit InfiniDB online forums• Trial the InfiniDB Enterprise Edition:

http://www.calpont.comwww.infinidb.org

Robin SchumacherVP Products

Calpontrschumacher@calpont.com

Thanks!