Big Data Management in HANA BW

8/10/2019 Big Data Management in HANA BW

1/20

SAP HANA BW DevelopmentSeptember 2014

Big Data Management in SAP BW on HANA

Project: HANA dynamic tiering


2/20

2014 SAP AG. All rights reserved. 2Customer

This presentation outlines our general product direction and should not be relied on

in making a purchase decision. This presentation is not subject to your license

agreement or any other agreement with SAP. SAP has no obligation to pursue any

course of business outlined in this presentation or to develop or release any

functionality mentioned in this presentation. This presentation and SAP's strategy

and possible future developments are subject to change and may be changed bySAP at any time for any reason without notice. This document is provided without a

warranty of any kind, either express or implied, including but not limited to, the

implied warranties of merchantability, fitness for a particular purpose, or non-

infringement. SAP assumes no responsibility for errors or omissions in this

document, except if such damages were caused by SAP intentionally or grossly

negligent.

Disclaimer


3/20


Topics

Recall: Data LifeCyle Management in BW-on-HANA

Next step: HANA dynamic tiering for BW


4/20

2014 SAP AG. All rights reserved. 4

PerformanceData Volume

Data is read and/or written frequently

In memory

No restrictions, all features available

Infrequent access On disk, only loaded to memory when accessed


Sporadic access

Not stored in HANA DB; stored in Near-line Storage

Restricted to NLS capabilities

Multi Temperature Data Management for BW on HANA

Providing lower TCO by optimized data management

hot

warm

cold

Non-Active Data Concept

Near-line Storage


5/20


PerformanceData Volume

Data is read and/or written frequently

In memory


Infrequent access On disk, only loaded to memory when accessed


Sporadic access

Not stored in HANA DB; stored in Near-line Storage

Restricted to NLS capabilities

Multi Temperature Data Management for BW on HANA

Providing lower TCO by optimized data management

hot

warm

cold

HANA dynamic tiering

Near-line Storage


6/20


Virtual Layer

BEx Query

Staging Layer

Analytic Mart

Business Transformation

EDW

Propagation

EDW Transformation Corporate

Memory

Archive/NLS

Hot-Warm-Coldareas in BW on HANA

Cold AreasArchive, read-only data, different SLAs

Hot Areasheavy reporting and/or HANA-native operations (Delta, Transf.,)

Warm Areaslimited reporting, limited HANA-native functions


7/20 2014 SAP AG. All rights reserved. 7

Archive/NLS

Hot-Warm-ColdData Distribution in BW

Staging Analytics +

Reporting

Transform &

Harmonize

Data

Corporate

Memory

Focus of HANAdynamic tiering



HANA dynamic tiering

Extended Storage: Disk

Primary Storage: RAM

Extended

Table

Remote

Table

HANA

Table

Additional table type: ExtendedTable

Storage based on SAP IQ

technology

Similar compression rates

Optimized data transfer between

Primary and Extended Storage

Data Processing is pushed to

Extended Storage server



HANA dynamic tieringpart of the HANA platform

Extended Storage: Disk

Primary Storage: RAM Unified Installation&UpdateManagement

One Backup & Recovery

HANA Studio Integration

Monitoring Tracing

Configuration (.ini file)

Start/Stop

HANA topology includes ES as a

node

Security/User Managementby

HANA-only



HANA dynamic tiering for BW

Extended Storage

Primary Storage

Extended

Table

Remote

Table

HANA

Table

BW: Process Management

DSODSO

BW Objects can haveproperty Extended Table

No change to applications,

process required

Conversion to move existing

data to Extended Storage

Move data to ES during DB

migration



Extended Tables in HANA BWUse Case: Staging and Corporate Memory

BW DataSources and write-

optimized DSOs can have theproperty Extended Table

Generated Tables are of type

Extended

Write and Read operations arere-directed to ExtendedStore

All BW standard operations

supportedno changes

Only minor temporary RAMrequired in HANA

DataSourceDataSource

DataSource

wo-DSOwo-DSO

wo-DSO

Corporate MemoryStaging Area

Extended Storage

Primary Storage

Active

Table

Remote

Table

PSA Table

Remote

Table



HANA Extended Storage for BWRoadmap

Extended Storage

Primary Storage

Extended

Table

Remote

Table

HANA

Table

BW: Process Management

DSODSO

Enable ES for additional BWInfoProvidersalso on data

slices/partitions

Automated + Modeled data

movements based on HANA

DB & BW statistics

Even tighter integration in

HANA platform

Deployment options by

HANA HW partners



HANA dynamic tiering & BW NLS

Extended Storage

Continuous operations data

Mission-critical availability

Optimizing on HANA RAM

Part of the platform

Software version dependencies

Complete tables/partitions

BW NLS

Archive, read-only

Usually lower SLAs

Optimizing data footprint in system

landscape

Separate server

Downward compatibility

Arbitrary (semantic) data slices

Two different types of data require two different types of storages


14/20 2014 SAP AG. All rights reserved. 14Customer

HANA dynamic tiering for BW on HANA

Availability

Pilot Shipmentended August 2014 (see note 1983178)

Minimal software versions

SAP HANA SP07

SAP BW7.4 SP05

SAP IQ 16.0 SP03

General Availabilityplanned for Q4 2014

Minimal software versions

SAP HANA SP09

SAP BW7.4 SP08

Sizing guidelineadopted sizing report in note 1736976

BW on HANA FAQ - http://spr.ly/bwonhanafaq

TechEd 2013: http://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhana
https://css.wdf.sap.corp/sap/support/notes/1983178http://service.sap.com/sap/support/notes/1736976http://spr.ly/bwonhanafaqhttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://www.experiencehana.com/community/blogs/blog/2013/11/06/big-data-pb-of-in-bwonhanahttp://spr.ly/bwonhanafaqhttp://spr.ly/bwonhanafaqhttp://service.sap.com/sap/support/notes/1736976https://css.wdf.sap.corp/sap/support/notes/1983178


15/20

Thank you

Contact information:

Dr. Stefan Hoffmann, SAP HANA BW Product Management

[email protected]

Dr. Klaus Nagel, SAP HANA BW Development

[email protected]
mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]


16/20

Appendix


17/20

2014 SAP AG or an SAP affiliate company. All rights reserved. Customer 17

SAP Sybase ODBC Driver

HANA DB

InfoProvider

NLS Interface

Near Line Adapter (ABAP based )

BW

DBSL for

Sybase ASE (/w IQ ext.)

(Kernel based; Open SQL + Native IQ

SQL via ADBC)

BW Porting

General

Porting

DB Client

BW NLS Solution for SAP IQ

(DBSL based solution)


18/20


Not-Active Data ConceptHANA

Tables in HANA can be marked with a high unload priority(not-active). Thisproperty is inherited by all partitions of such tables.

The partitions of the not-active tables are

loaded to RAM in case of read access (column-wise) and processed as usual (same speed

and functionality),

loaded to RAM for mergeprocess (if new data was written and delta reaches limit),

displaced from RAM with highest priority in case of RAM shortage (but only then) or when

actively a cleanup is triggered.

Filer

RAM

Persistent data

Processing data

Temporary dataThe cautious displacement strategy avoids a

sub-optimal memory strategy, e.g. in case of

subsequent accesses, but it may be altered aftermore experience.


19/20


Extended Tables in BWDeployment option 1

HANA Appliance

Slave 5

Slave 4

Slave 3

Slave 2

Slave 1

Master

Slave 6

Original sizing config Sizing config enablingExtended Storage

HANA Appliance

Extended Storage

Slave 3

Slave 2

Slave 1

Master

PSA andCorpMemory

approx. 40%

of data


20/20

2014 SAP AG All rights reserved 20C t

Commodity HW

Extended Tables in BWDeployment option 2

HANA Appliance

Slave 5

Slave 4

Slave 3

Slave 2

Slave 1

Master

Slave 6

Original sizing config Sizing config enablingExtended Storage

HANA Appliance

Extended Storage

Slave 3

Slave 2

Slave 1

Master

PSA and

CorpMemory

approx. 40%

of data

High-speedconnectivity

Big Data Management in HANA BW

Documents

Transcript of Big Data Management in HANA BW