1 Copyright © 2013, Oracle and/or its affiliates. All ... slim, more smartly ... Update to INSERT...
Transcript of 1 Copyright © 2013, Oracle and/or its affiliates. All ... slim, more smartly ... Update to INSERT...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 2
SAP In-Memory Computing, ein Wendepunkt ? Vertrauen in Oracle Technologie.
Stefan Menschel Master Principal PreSales Consultant Business Unit Server Technology - Datenbank Oracle Deutschland B.V. & Co. KG
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4
Market Trend
Databases Random Access Memory
Flash Storage
Central Processing Unit
Software Hardware
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5
Data, Data, Data, …… Data are IN § Data Analysis is becoming important in the foreground § Databases are perceived at all levels of the IT § Database specialists are needed § Database-driven developers have a future § Database Architects / good DBAs have a future
à In-Memory Computing à Big Data Databases are IN
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6
The Database Market is dynamic Databases are IN
Oracle DB TimesTen
MySQL
MariaDB
DB2 RDB
MemSQL
Couchbase
Oracle noSQL
Vertica
ExaSol
SQLServer
Teradata
BerkleyDB
Sybase
SAP Hana
SolidDB Basko
Mongo DB Postgres
Informix Aerospike
Datastax
Voldemort
HBase
Cassandra
Neo4J
.... and many more
AmazonRDS
Essbase
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7
Infrastructure Conventional Systems Standardization
§ Database Server - individual Manufacturer - Operating System xy - Virtualization - Patch Level xy § complex Deployment
§ Maintenance § Finger-Pointing § High Availability / Scalability
à more complex § Risk (Patching) § many different tools for
Monitoring & Administration
§ Storage Array - individual Manufacturer - Operating System xy - Patchlevel xy
§ Host Bus Adapter - individual Manufacturer - Firmware xy
§ FC-Switch - individual Manufacturer - Firmware xy
? à Contradiction !
UNIQUE SYSTEM
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8
Oracle Engineered Systems
Exadata Supercluster
Exalogic Database Appliance
ODBLRA
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 9
Oracle Engineered Systems Advantage : Standardization
Reduce IT Costs § faster Deployment § speed Business Value § less Operations § less Mainentance § less Finger-Pointing § High Availability
Scalability included § less Risk
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10
Oracle Engineered Systems Advantage : Performance out of the box
Exadata, first Turbo for your Data.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11
SAP In-Memory Computing ein Wendepunkt ?
SAP HANA is a completely re-imagined platform for real-time business.
SAP Business Suite on HANA, Change the Game.
SAP HANA is Real Real Time Computing
Fast, slim, more smartly with SAP in-MEMORY Computing are you the competition always a step ahead
SAP HANA accelerates analytics and applications on a single, in-memory platform. Get ready for real-time business
"We have already changed the game and we are moving onto the next frontier.“ SAP CTO Vishal Sikka 2013-09-22
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12
In-Memory Computing (In-Memory Data Management IMDM)
Why ?
§ Growth of Databases § Big Data
§ Data Silos (OLTP+OLAP)
§ MultiCore CPU § RAM
§ SSD
Reality § Real Time Computing
§ Analytics § Performance à Speed
§ Simplify IT
Demand
„Everything must go fast. We live in an NOW economy. “ Gartner 2002
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13 [email protected]
In-Memory Data Management
SAP HANA = Database ?
YES
HANA is an application platform, not a database. http://www.saphana.com/community/blogs/blog/2013/07/18/the-top-10-sap-hana-myths-spread-by-other-vendors
YES
NO
What is it ?
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14 [email protected]
SAP HANA (Database) – Central Part of SAP Real Time Data Platform
SAP HANA Database
SAP Sybase ASE (Database)
SAP Sybase IQ (Database)
SAP Sybase ESP (Event Sream Processor)
SAP Sybase SQLA (SQL Anywhere)
SAP Real Time Data Platform
SAP Netweaver HANA App Server
SAP Business Suite
SAP Business Warehouse
SAP Big Data Applications
SAP Analytics
SAP Mobile
Custom Apps
SAP HANA Appliance
Sybase ASE run on Infrastructure
Sybase IQ run on Infrastructure
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15 [email protected]
In-Memory Data Management What is different ?
Last Name
First Name
Email Phone# Street Address
Last Name
First Name
Phone#
Street Address
IMDM (new) Column Based (Column Store)
DISC
RAM RAM
+ INSERT new record + UDATE existing record - useless reads
+ read only relevant data + high compression - INSERT / UPDATE complex – Persistence on Disc
Traditional Row Based (Row-Store)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16
Func
tiona
lity
Requirements of a Database Not Everything is about Performance !
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17
Func
tiona
lity
SAP HANA Specialized Database for Analytics
Query Performance based
on high compressed In-Memory
Column Store
Missing Functionalitys
in SAP HANA
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18
Multiple Changes to go to SAP HANA The Requirements for more Performance
new Database other dedicated Database Server other dedicated Storage System
Application(s) powered by SAP HANA
new Application(s) SAP Netweaver BI powered by SAP HANA SAP Business Suite powered by SAP HANA Appl. Accelerator(s) for SAP HANA
other Backup / Restore Functionalities
other HA Features other Scalability Features
... and all in 1 Step
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19 [email protected]
SAP HANA Fundamentals – Load Operations
A1
B1
C1
D1
E1
A2
B2
C2
D2
E2
A3
B3
C3
D3
E3
A4
B4
C4
D4
E4
A5
B5
C5
D5
E5
A6
B6
C6
D6
E6
Oracle DB
A1
A2
A3
A4
A5
A6
SAP HANA Disk and SSD
B1
B2
B3
B4
B5
B6
C1
C2
C3
C4
C5
C6
D1
D2
D3
D4
D5
D6
E1
E2
E3
E4
E5
E6
Initial Load
A1
B1
C1
D1
E1
A2
B2
C2
D2
E2
A3
B3
C3
D3
E3
A4
B4
C4
D4
E4
A5
B5
C5
D5
E5
A6
B6
C6
D6
E6
SAP Business Objects Data Services SAP Landscape Transformation Services
Permanent Store Column Store on Disk
®
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20 [email protected]
SAP HANA Fundamentals – Read Operations
SAP HANA
C1
C2
C3
C4
C5
C6
D1
D2
D3
D4
D5
D6
E1
E2
E3
E4
E5
E6
SELECT col1, col2 FROM tab WHERE col1 = A4 AND col2 = B3;
A1
A2
A3
A4
A5
A6
B1
B2
B3
B4
B5
B6
load 100% of the column in memory on demand
MainStore
A1
A2
A3
A4
A5
A6
PK – Index
B1
B2
B3
B4
B5
B6
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21 [email protected]
SAP HANA Fundamentals – Write Operations
SAP HANA
C1
C2
C3
C4
C5
C6
D1
D2
D3
D4
D5
D6
E1
E2
E3
E4
E5
E6
A1
A2
A3
A4
A5
A6
B1
B2
B3
B4
B5
B6
UPDATE tab SET col1 = ‘AX‘ WHERE col1 = A5;
Update to INSERT into DeltaStore (INSERT only Mode)
DeltaStore
AX
write DELTA to
COMMIT Log on SSD
A5
Read Operations
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22 [email protected]
SAP HANA Fundamentals – Merge Process
SAP HANA
C1
C2
C3
C4
C5
C6
D1
D2
D3
D4
D5
D6
E1
E2
E3
E4
E5
E6
A1
A2
A3
A4
A6
B1
B2
B3
B4
B5
B6
Asynchronous Single Column Merge Operation DeltaStore à MainStore
AX
Lock on DeltaStore
A1
A2
A3
A4
A X
A6
Copy of MainStore
new empty
DeltaStore
More CPU ... Double RAM of MainStore ... Savepoint creates Disk I/O
write Savepoint (complete MainStorage) for Persistence on Disk
Rebuild Index
I/O
Lock on MainStore
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23 [email protected]
SAP HANA
C1
C2
C3
C4
C5
C6
D1
D2
D3
D4
D5
D6
E1
E2
E3
E4
E5
E6
A1
A2
A3
A4
A6
B1
B2
B3
B4
B5
B6
AX
A1
A2
A3
A4
AX
A6
Exchange MainStore with new „MainStore“
X X
new DeltaStore
MainStore DeltaStore
Copy of Main Store New DeltaStore
SELECT col1, col2 FROM tab WHERE col1 = AX AND col2 = XX;
SAP HANA Fundamentals – Consequences
Lower Performance
for Read + Write Operations
Per
form
ance
Read from
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24 [email protected]
SAP HANA Fundamentals – Passiv Data
SAP HANA
C1
C2
C3
C4
C5
C6
D1
D2
D3
D4
D5
D6
E1
E2
E3
E4
E5
E6
A1
A2
A3
A4
AX
B1
B2
B3
B4
other SAP Databases run on other Infrastructure
Sybase IQ
Sybase ASE
Persistence of Nearline Storage for Passiv Data
B5
B6
A5
A6
B5
B6
A5
A6
X X
Passiv Data
Aktiv Data
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25 [email protected]
In-Memory Database Power Failure : Consequence
User
Application Server
HANA DB Server + HANA Storage
SAP ERP
User
Application Server
HANA DB Server + HANA Storage
Server Side Failover
1:1 System Replication
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 26
Shared Nothing Cluster Distributed SAP HANA System
DB Partition 1
Worker Node
Index Server Statistic Server Name Server (Row Store)
Column Store SAP HANA Studio
HD Flash
data01 log01 Primary Data
Replica
Shared Filesystem - GPFS
SAP HANA Database
Node 1
DB Partition 2
Worker Node
Index Server Statistic Server Column Store
Backup Name Server
HD Flash
data02 log02
Node 2
DB Partition 3
Worker Node
Index Server Statistic Server Column Store
HD Flash
data03 log03
Node 3
Standby Node
Index Server Statistic Server
HD Flash
Node 4
®
not supported for SAP Business Suite on HANA
(SAP Note 1825774)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 27 [email protected]
Source : SAP HANA Documentation: http://help.sap.com/hana_appliance/
Fact : HANA Cluster = no HA Solution !
Shared Nothing Cluster Add a new Node to the Cluster
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 28 [email protected]
Backup & Recovery Not Enterprise Ready Full Backup Only
- no support for incremental backups No Granularity Beyond Data Files and Logs - no support to backup and recover database objects No Integrated Tape Backup / Limited Media Management Support - backups only to a specified disk destination Poor Design Around Backup Catalog – Significant Data Loss Exposure - Backup Catalog is located inside the HANA database itself à database gets corrupted / destroyed, all relevant backup information will be lost Inefficient Recovery Process - database recovery process, once started, cannot be interrupted Lacking Several Enterprise-level Backup & Recovery Features - missing are: backup encryption, backup compression, validation of backup & restore without actually doing the backup & restore, block recovery, incrementally updated backups, optimized backups, parallel backup channels, media management integration
§ Block Corruptions § Logical Errors
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 29
Multivendor for HANA Appliance
SAP HANA Appliance à “special optimization” at the system level à different HANA Appliances
IBM x3690, x3950 X5 HP Proliant BL680c G7, DL980, DL580 Dell PowerEdge R910 Cisco UCS B440 M2, C460 M2, C260 M2 Fujitsu RX600 S6, RX900 Hitachi CB2000, Unified Compute Platform (UCP) NEC Express A1040a, A1080a VCE Specialized Vblock for SAP HANA Huawei Tecal RH5885 V2 for SAP HANA
9 Server Brands – 18 Server Models
Source: “Validated SAP Partner Hardware”, SAP HANA Hardware Specifications & Product Availability Matrix (PAM)
High Complex High Risk Complex Patching
NetApp FAS3240 HP X9300 Network Storage System HP P6500 Enterprise Virtual Array NEC Storage M500 Viridient FlashMax IBM DS3524 Hitachi AMS 2100 Fusion I/O Dell Compellent SC8000 EMC VNX 5000 EMC VNX 7000 Netapp
9 Storage Brands – 11 Storage Models
IBM GPFS ext3 XFS
Three File Systems
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 30
Multivendor - Consequences Lacks end-to-end manageability à multiple tools & support from different HW vendors
Different Management Solutions of SAP HANA Appliances
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 31
Architecture Limitations
with HANA SP 4 (October 2012) § no system consolidation possible (note 1661202) § one HANA appliance (“system” or “cluster”) can only accommodate one HANA database (SID).
For test systems, multiple databases on one appliance are supported provided that it is installed by a certified SAP consultant
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 32 [email protected]
Consequence HANA based Datacenter (Production Environment)
User
Application Server
HANA DB Server + HANA Storage
SAP Netweaver BI
User
Application Server
HANA DB Server + HANA Storage
SAP ERP
User
Application Server
HANA DB Server + HANA Storage
SAP HR
...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 33 [email protected]
DSAG Blaupause Nr. 25 in 2013 „Die technische Installation von SAP HANA dauerte lediglich zwei Monate. Und dann wurde es doch noch etwas aufwendiger. ... Da muss alles fein aufeinander abgestimmt werden. Der Replikationsmechanismus, also wie die ERP Daten möglichst schnell und reibungslos nach SAP HANA kommen, wie lange das dauert etc., all das muss geprüft und getestet werden. Dafür sind dann auch wirklich die SAP Experten vor Ort gefragt...“ Marcus Gerke, CIO der TRILUX GmbH & Co. KG und Mitglied des DSAG CIO Beirats
Experience from German Customer
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 34 [email protected]
Other Customer Experience with
SAP HANA
„As to the re-implementation, I have to disagree with you. I was on a project to migrate a SAP app (whose name cannot be mentioned here) to HANA. Admittedly 30% of the functionality runs at least 10X times faster out of the box. However for the rest 70%, after almost a whole year's efforts from both SAP and ourselves in re-writing and re-testing, we eventually achieved a like-for-like performance on a much more modern hardware platform. My point here is there are certain workloads running much better in row-oriented DBMS, and you do have to optimize the codes when you migrate to a full column oriented DBMS.“ Source : http://www.saphana.com/community/blogs/blog/2013/10/08/why-wait-for-100x-performance 2013-10-30 „Also, SAP HANA is not pre-optimized to support non-SAP applications, which requires significant application re-engineering on the part of enterprise IT groups.“ Source : http://wikibon.org/wiki/v/Primer_on_SAP_HANA 2013-10-31
Application Re-Implementation
„In TAMKO's case, the HANA RDS didn't include the development of a security model, so the company had to bring in a security consultant at additional cost.“ Source : http://www.infoworld.com/d/applications/early-sap-hana-customers-separate-reality-the-hype-205262?page=0,1 2013-10-31
Security + Costs
Die Sicherung und Wiederherstellung einzelner Datenbank Objekte ist nicht möglich. Um die SAP HANA Datenbank wiederherzustellen, muss die Datenbank komplett heruntergefahren werden. Source : http://jk-netzwelt.de/?p=5924 2013-10-31
Backup/Recovery
Performance Factor 10x Only Complete Restore need Code Optimizations less Security
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 35 [email protected]
SAP HANA What does it mean ?
§ optimized solution for analytics § improved BW Queries § improved data load processes § new reporting functions
pro § new additional expensive SAP License § high implementation costs § high risk – complete new database § complex Data Replication
(HANA as Accelerator) § Investments cannot be otherwise used § new operational processes § more complex § frequent patching cycle § operating system only SUSE Linux § less database functionalitys
(Backup / Recovery, Security, HA, Scalability, ...) § several monitoring / admin tools § re-writing program codes
cons
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 36
SAP Commitment Next Innovations
Open Choice and Full Support to Customers SAP remains committed to support its customers’ choice of database technologies and vendors. SAP will continue to provide innovation for all databases supported and work with its database partners to support these innovations, which may include in-memory optimizations.
http://www36.sap.com/corporate-en/news.epx?PressID=20221
SAP Business Suite remains open to other database technologies and vendors and only one version of SAP Business Suite goes forward without disruption. Innovations in the SAP Business Suite, such as push down of data centric processing logic from the application server to database tier via stored procedures would be made available to other databases too making them perform better too.
http://www.saphana.com/community/blogs/blog/2013/01/10/a-promise-delivered-sap-business-suite-is-now-powered-by-hana
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 37
Video Prof. Dr. H.C. Hasso Plattner SAPPHIRE Orlando 2013
(2 minutes)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 38
UST – TRUST – TRUST – TRUST – TRU TRUST – TRUST – TRUST – TRUST - TRU TRUST – TRUST – TRUST – TRUST - TRU TRUST – TRUST – TRUST – TRUST - TRU TRUST – TRUST – TRUST – TRUST - TRU TRUST – TRUST – TRUST – TRUST - TRU TRUST – TRUST – TRUST – TRUST - TRU TRUST – TRUST – TRUST – TRUST – TRU
RDBMS - Market Leader
Vertrauen in Oracle
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 39
Oracle Technology Engineered to Work Together
Oracle DB Oracle Infrastructure
Oracle Database § Oracle 11g § Oracle 12c
- Multitenant Database - In-Memory Columnar Technology - Heat Map - Automatic Data Optimization
Oracle Infrastructure § Oracle Engineered Systems
- Exadata Database Machine - Exalogic Elastic Cloud - Supercluster - Database Appliance - Exalytics
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 40 [email protected]
Oracle RDBMS Technology Innovation
§ Client Server Architektur
§ Multiversion Concurrency Control (MVCC)
§ Oracle Parallel Server § PL/SQL § Row – Level - Locking
Release 4 (1984)
Release 5 (1985)
Release 6 (1988)
§ Foreign Key Constraints § Stored Procedures § Trigger § Datatype LONG
Release 7 (1992)
§ Cost Based Optimizer § Transportable Tablespaces § Unicode UTF 8 § Datatype CLOB, BLOB § Function Based Index § Online Reorg Index § Index org. Tables IOT
Release 8 (1997)
§ Online Reorg Table § Undo Segment § Partitioning § Flashback § Bitmap Index § Real Application Clusters
Release 9 (2001)
§ Recycle Bin § ASM (Storage Volume Manager) § ADDM (Diagnostic Monitor) § SQL Profile
Release 10 (2003)
§ Compression § Datatype Secure Files § Deferred Segments
Release 11 (2007)
Performance - Flexibility – Availability - Scalability - Security - Manageability Best in
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 41 [email protected]
Oracle RDBMS The Next Innovation
"Oracle Database 12.1c will be a "columnar, compressed, high-speed, in-memory database." Ellison said during Oracle's quarterly earnings call Thursday "One reason I was confident SAP HANA could never compete with Oracle was because of 12.1c."
Source : June 20 , 2013 http://www.computerworld.com/s/article/9240232/Oracle_s_Ellison_spills_beans_on_upcoming_SAP_HANA_competitor_and_Database_12c_plans
Release 12 (2013)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 42
Oracle Database 12c In-Memory Option
§ Leading edge In-Memory technology - seamlessly integrated into Oracle Database
§ Delivers Extreme Performance for - Analytics and Ad-Hoc reporting on live data - Enterprise OLTP and Data Warehousing - Scale-up and Scale-out
§ Trivial to Deploy for All Applications and Customers
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 43
§ BOTH row and column in-Memory formats for same table
§ simultaneously active and transactionally consistent
§ analytics & reporting use NEW column format
§ OLTP uses row format
Breakthrough : Dual Format Oracle In-Memory Database
Column Format
Memory
Row Format
Memory
Analytics OLTP Sales Sales
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 44
Oracle 12c : Store Data in Both Formats Simultaneously
Optimizing Transactions and Query Performance Row Format Databases vs. Column Format Databases
Row § OLTP runs best on row format
– Operates on few rows, many columns
Column § Analytics runs best on column format
– Operates on few columns, many rows
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 45
Func
tiona
lity
Oracle Database Multi-Purpose Database
In-Memory Column Store in Oracle 12.1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 46
Why Considering Engineered Systems for SAP Safe Transition to a New Era
§ runs SAP unchanged
§ eliminate systems integration trial-and-error
§ better performance out-of-the-box
§ reduce vendors to Oracle and SAP
§ best support (identical hw in Walldorf)
§ fast and online migration
§ apply existing personnel, skills, Oracle licenses
§ less administration, simpler patching, greater uptime
§ consolidate platforms and databases, reduce power and cooling
High Integrated Products for Extreme Performance
+
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 47
®
Simplify I.T. Engineered Systems
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 48 [email protected]