SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data...

22
SAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology (MIT) Visiting Professor March 23rd 2012 SAP Academic Conference Americas, San Antonio

Transcript of SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data...

Page 1: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

SAP HANA: In-Memory Data Management

for Enterprise Applications

Dr. Alexander ZeierMassachusetts Institute of Technology (MIT)

Visiting Professor

March 23rd 2012SAP Academic Conference Americas, San Antonio

Page 2: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

The Vision by Prof. Hasso Plattner

Transactional (OLTP) and analytical(OLAP) data processing has to be on one system againEnterprise applications have to reflect latest developments in:

Hardware, such as:Multi-core processors Huge Main Memory

Data management, such as:Column-oriented storageLight-weight compression

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT2

Page 3: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

In-Memory Technology Enables Combining OLTP and OLAP in Real-Time

Data-centric architecture: In-Memory database serves as single source of truth for ERP dataArchitecture based on 4 distinct pillars

Multi-Core computingIn-MemoryColumn and Row StoreInsert-Only

Enables informed management decisions based on up-to-the-moment data through real-time combination of

Transactional applicationsAnalytical applications

Enterprise PerformanceIn-Memory Circle (EPIC)

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT3

Page 4: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

In-Memory Data ManagementAdvances in Hardware

64bit address space – 2TB in current servers

100GB/s data throughput

Dramatic decline in price/performance

Multi-Core Architecture(8 x 10core CPU per blade)

Parallel scaling across blades

One blade ~$50.000 = 1 Enterprise Class Server

Advances in Software

+Row and

Column StoreCompression Partitioning No Aggregate

Tables

++

++Insert Only

4

A

On-the-flyextensibility

+ + +

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 5: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Any attribute as index

Insert onlyfor time travel

Combined columnand row store

+

No aggregatetables

Minimalprojections

Partitioning

Analytics onhistorical datat

Single andmulti-tenancy

SQL interface on columns & rows

SQL

Reduction oflayers

xx

LightweightCompression

Multi-core/parallelization

5

On-the-flyextensibility+ + +

Active/passivedata storePA

Bulk load

++

+ +

T Text Retrieval and EXploration

Object to relational mapping

Dynamic multi-threading within nodes

Map reduce No diskGroup Key

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 6: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Row Store

Column Store

Row vs. Column Store

Row4

Row3

Row2

Row1

Two Different Principles of Physical Data Storage: Row vs. Column Store

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT6

Page 7: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Accessing Enterprise Data

Column StoreRow Store

7

SELECT * FROM Sales Orders WHERE Document Number = ‘95779216’(OLTP-style query)

SELECT SUM (Order Value) FROM Sales Orders WHERE Document Date > 2009-01-20(OLAP-style query)

Row4

Row3

Row2

Row1

Row4

Row3

Row2

Row1

DocNum

DocDate

Sold-To

ValueStatus

SalesOrg

DocNum

DocDate

Sold-To

ValueStatus

SalesOrg

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 8: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Dictionary Compression

8

Reduces I/O operations to main memory (bottleneck)Operations directly on compressed data

Dictionaries8

• Typical compression factor for enterprise software 10

• In financial applications up to 50

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 9: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Table Characteristics

Row Store Column StoreSmall tables

Frequent updatesMaterialized aggregates

Large tablesRare updates

Dynamic aggregates

TransactionalData

Historical Data

Direct access to tuplesBlade-local transactions

Status updatesActive / passive

Sequential accessNo updates

9

TextCrawler

Join structured & unstructured data

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 10: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Innovative In-Memory / HANA

Applications

10 In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 11: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Nowadays Financials

11 In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 12: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Simplified Financials(Target)

Only base tables, algorithms, and some indices

12 In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 13: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Customer Study 1:Dunning Run in < 1s?

Dunning run determines all open and due invoicesCustomer defined queries on 250M recordsCurrent system: 20 minNew logic: 1.5 sec

• In-memory column store• Parallelized stored procedures• Simplified Financials

13 In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT

Page 14: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

Dunning Application

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT14

Page 15: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

GORFID

Tracing pharmaceutical packages in Europe

15 bn packages / 35 bnread events per year

Prototype with 12 billions

records with response time:

23 ms15

Page 16: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

HANA Oncolyzer

• Medical doctors have all patientdata at hand to apply personalized medicine

• Medical researchers performreal-time analysis to definecohorts for clinical studies

• International research initiativefor exchanging relevant tumordata started at World Health Summit 2011 in Berlin

• In-Memory Technology as

• key-enabler for real-time analysis

• provider for information at your fingertips (iPad)

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT16

Page 17: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

HANA Oncolyzer - combining Structured and Unstructured Data

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT17

Page 18: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

HANA Oncolyzer was presented on CeBIT 2012 to Germany’s Chancellor

Angela Merkel as SAP`s Innovation 2012

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT18

Page 19: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

First Results of Customers using SAP HANA

• 1,000x Faster: Many (Dunning, Aging, …)• 10,000x Faster: NongFu Spring, Essar Group, SAP IT,

Cornell, Charmer Sunbelt • 100,000X Faster: YodoBashi, MKI

OR

• 24+ Hours to 3.8S: Food and Beverage / Distribution - Logistics• 15+ Hours To 4.8S: Project Management /

Services, Profitability, Performance• 30 Days to 28S: Manufacturing – Order to Cash• 3 Days to 2s: Retail / Insurance – Incentives

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT19

Page 20: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

All Findings are Summarized in the Book “In-Memory Data Management”

This book is the culmination of five years worth of in-memory research

PART I – An Inflection Point for Enterprise ApplicationsOverview of our vision of how in-memory technology will change enterprise applications

PART II – A Single Source of Truth through In-MemoryTechnical foundations of in-memory data managementIn-depth description of how we intend to realize our vision

PART III – How In-Memory Changes the GameResulting implications on the development and capabilities of enterprise applications

-> Book launched at Cebit 2011, SAP Product HANA is available since June 2011.

-> New extended Book Edition “In-Memory Data Management -Technology and Applications ” focusing on Application Development will be available for Sapphire May 2012.

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT20

Page 21: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

In-Memory/HANA Drives Worldwide Innovation

Book Launch at CeBIT 2011 with Vice-President of the European Commission Neelie Kroes

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT21

Page 22: SAP HANA: In-Memory Data Management for Enterprise ... · PDF fileSAP HANA: In-Memory Data Management for Enterprise Applications Dr. Alexander Zeier Massachusetts Institute of Technology

22

SAP and HPI win the German Innovation Award 2012

for SAP HANA!This year’s winners were announced am March 16, 2012 in Munich, Germany.

Please feel free to contact me:

Dr. Alexander ZeierMassachusetts Institute of Technology (MIT) Visiting Professor Executive Director MIT Forum for SC Innovation Email: [email protected] with list of over150 Publications: http://zeier.mit.edu

In-Memory/HANA Enterprise Data Management | SAP UA Conference | March 23rd 2012 | Dr. Alexander Zeier, MIT