SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

24
HANA2 Dynamic Tiering This is a compilation of notes collected exploring and testing features of Dynamic Tiering in HANA2 May 2017 This is a ‘continuation’ of the first blog, SAP HANA Dynamic Tiering Test- drive , exploring the features of Dynamic Tiering before the HANA2 By OZSoft Consulting for ITConductor.com Author: Terry Kempis Editor: Linh Nguyen ITConductor.com 1

Transcript of SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Page 1: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

HANA2 Dynamic Tiering

This is a compilation of notes collected exploring and testing features of Dynamic Tiering in HANA2

May 2017

This is a ‘continuation’ of the first blog, SAP HANA Dynamic Tiering Test-drive, exploring the features of Dynamic Tiering before the HANA2

By OZSoft Consulting for ITConductor.com

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 1

Page 2: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

References

HANA2 Dynamic Tiering Guides

• Dynamic_Tieiring_Option_Release_Notes

• Dynamic_Tieiring_Option_Master_Guide

• Dynamic_Tieiring_Option_Installation_Guide

• Dynamic_Tieiring_Option_Administration_Guide

HANA2 Administration Guide

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 2

Page 3: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Introduction (1)

The first blog SAP HANA Dynamic Tiering Test-drive covered the following• Overview of HANA’s multi-temperature data management (HOT, WARM, COLD)

• Installation of DT and adding host, data provisioning to a tenant DB and creating extended storage (ES)

• WARM table

1. Create WARM table using ES

2. Copy data from HOT to WARM table, and deleting the data from WARM

3. Creating view ‘joining’ HOT and WARM table for transparent access

4. Using visualize plan showing access to HOT and WARM table

• Backup

• Monitoring/Reporting

• HANA Cockpit tiles on DT

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 3

Page 4: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Introduction (2)

This blog will focus on following

• Co-host deployment

• Multi-Store Table oCreation

oAging and anti-aging

oVirtualize Plan

• Dynamic Tiering Tiles in the new HANA2 Cockpit

• New Backup feature/support in HANA2

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 4

Page 5: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Deployment

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 5

Pre-HANA2(Production)

HANA2(Production)

Host1 Role=Worker

Host..nRole=Extended Storage

Worker/Standby

Cohost Deployment is not recommended in production

HOST1Host Role (Worker, Extended Storage)

HOST2 Role (Worker, Extended

Storage Worker/Standby)

Host.nRole=Worker

Host..nRole=Extended Storage

Worker/Standby

Cohost deployment in production is supported. ES configuration parameters available to avoid impact on performance

Page 6: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Dynamic Tiering Installation / Add Host role

• Using HANA Cockpit (Life Cycle Management)

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 6

Add role to existing host

Installation

Page 7: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

HANA2 Cockpit – Dynamic Tiering

When an ‘extended storage’ has been provisioned to a tenant DB, the Dynamic Tiering options will appear in HANA2 Cockpit for that tenantDB

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 7

Page 8: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Dynamic Tiering Tables

There are two types of tables in Dynamic Tiering option

1. Extended table - table specifically created with all data stored into the extended storage (ES).

This was explored in the previous blog SAP HANA Dynamic Tiering Test-drive

2. MultiStore table – partitioned table with some partitions stored in the in-memory, and some partitions in the extended storage – new in HANA2.

The following slides shows the differences on the table creation, moving data into ES, making the access to the table transparent – regardless of the location of the data.

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 8

Page 9: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Dynamic Tiering Tables

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 9

Extended TableA table can only reside in

either in-memory (HOT) or extended storage (WARM)

WORKER host(In-Memory)

HOT Tables(e.g.

TSP06_HOT)

Extended Storage host

WARM Tables(e.g.

TSP06_WARM)

MultiStoreMultistore table can have some part(s) in in-memory, and some parts in extended storage

HOST – roles (WORKER, ES Worker)

In-Memory

TSP06 tablePart1..Part2..Part3

Extended Storage DBspace

TSP06 TablePart4..Part5..

Page 10: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Dynamic Tiering - Table creation

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 10

Extended Table

WORKER host(In-Memory)

HOT Tables(e.g.

TSP06_HOT)

Extended Storage host

WARM Tables(e.g.

TSP06_WARM)

MultiStore TableDefine multistore table as partitioned, with some partitions in in-memory, while other partitions using extended storage

HOST – roles (WORKER, ES Worker)

In-Memory TSP06 table

Part1..Part2..Part3

Extended Storage DBspace

TSP06 TablePart4..Part5..

• CREATE TABLE TSP06_HOT …• CREATE TABLE TSO06_WARM USE

EXTENDED STORAGE

CREATE VIEW TSP06_ALL..JOIN TSP06_HOT, TSP06_WARM

The view will make the change transparent to existing access calls

CREATE TABLE … PARTITON BY RANGE.. USING DEFAULT STORAGE (Partition

definition) USING EXTENDED STORAGE (Partition definition)

(NO View needed)

Page 11: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Moving data (archiving/un-archiving)

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 11

Extended Table

WORKER host

HOT Tables(e.g.

TSP06_HOT)

Extended Storage host

WARM Tables(e.g.

TSP06_WARM)

MultiStore TableAging – moving data from in-memory to ES

ALTER TABLE …ALTER PARTITION.. USING EXTENDED STORAGE

(partition definition)

HOST – roles (WORKER, ES Worker)

In-Memory TSP06 table

Part1..Part2..Part3

Extended Storage DBspace

TSP06 TablePart4..Part5..

Step 1INSERT INTO TSP06_WARM

SELECT * from TSP06_HOTWHERE (criteria)

Step 2DELETE FROM TSP06_HOT WHERE (Criteria as per insert)

Moving data from In-Memory to ES

UN-Aging – moving data from ES to in-memory

ALTER TABLE …ALTER PARTITION.. USING DEFAULT STORAGE

(partition definition)

Page 12: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Multi-Store Table (1)

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 12

In-Memory

In-Memory

Extended Storage

Defining table with range partitioning on column PDPAPER – some partitions in DEFAULT STORAGE (In-Memory), some in Extended Storage

Page 13: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Multi-Store Table (2)

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 13

Partition information/Table definition

Page 14: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Virtualize Plan (1)

Select * (all data, from in-memory and extended storage)

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 14

Page 15: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Virtualize Plan (2)

Select data from partition 1 and 2 (from In-Memory)

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 15

Only partition 1 and 2 accessed – extended storage not involved

Page 16: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Virtualize Plan (3)

Select data from partition in the extended storage only

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 16

Page 17: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Other options (1)

A table can be moved to extended storage using HANA Studio

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 17

AFTER CONVERSION

For a partitioned table where all partitions were in DEFAULT storage, using this option will result in losing the partitioning values – i.e. will end up as extended storage table (not partitioned). Use ALTER partition instead

Page 18: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Other Options (2)

A table using extended storage can be converted to use in-memory, through HANA Studio

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 18

AFTER CONVERSION

Page 19: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

BACKUP (delta and incremental)

Delta (differential) and Incremental now supported for tenant with extended storage

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 19

Page 20: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

HANA2 Dynamic Tiering - Alert

Alert series 5nn are related to Dynamic Tiering

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 20

Page 21: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Additional notes (1)

• With HANA2, co-deployment is introduced in production, with new esserver.ini parameters to put threshold on the host so the extended storage activities does not impact the production performance

• As per OSS note 2086829, Dynamic Tiering licensing is ‘based on compressed storage on disk’ – not on memory

• Delta store feature allows concurrent update on table in extended storage

• Take note on sizing algorithm when allocating the DBSPACES – refer to the DT Administration Guide ‘Dbspace Sizing’.

• 2394124 - SAP HANA 2.0 Dynamic Tiering - Additional Information

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 21

Page 22: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Additional notes (2)

In MDC,

• The one-to-one relationship between tenant DB and extended storage (and vice-versa) still exist

• There can only one extended storage in a host

• Currently only one esserver service per host i.e. Tenant1 with ES in node1, and Tenant2 with ES in node2

This is still the case for HANA2 SPS01, i.e. if another tenant requires extended storage, it has to be created into another node.

• More information related to SPS01 on OSS note 2422585.

• System Replication - (extract from Admin Guide)• The operation mode logreplay_readaccess is not supported with

systems having Dynamic Tiering services.

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 22

Page 23: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

Monitoring Dynamic Tiering with IT-Conductor

Author: Terry KempisEditor: Linh Nguyen

ITConductor.com 23

If the DT is on a separate host, the DT host will monitored similar to the other hosts. In this example, ozdtnode1 is the extended_storagehost

If the dynamic tiering is co-deployed, the service ‘esserver’ will appear on that host’s services.

Page 24: SAP HANA 2 – Dynamic Tiering Overview including HANA Monitoring

• Any Questions?

• Contact Info:

Linh Nguyen [email protected]

Terry Kempis [email protected]

Let

itconductor.com

@itconductor