SAP HANA Training | SAP HANA Online Training | SAP HANA Course
DMM107 Capturing and Replaying Workload in SAP HANA · 2016. 9. 14. · SAP HANA SPS12 Basic...
Transcript of DMM107 Capturing and Replaying Workload in SAP HANA · 2016. 9. 14. · SAP HANA SPS12 Basic...
-
Public
DMM107 – Capturing and Replaying Workload in
SAP HANA
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 2 Public
Speakers
Bangalore, October 5 - 7
Lucas Kiesow
Las Vegas, Sept 19 - 23
Lucas Kiesow, SAP HANA
Product Management
Barcelona, Nov 8 - 10
Lucas Kiesow
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 3 Public
Disclaimer
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of
SAP. Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or
any other service or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this
presentation or any related document, or to develop or release any functionality mentioned therein.
This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms
directions and functionality are all subject to change and may be changed by SAP at any time for any reason without notice.
The information in this presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality.
This presentation is provided without a warranty of any kind, either express or implied, including but not limited to, the implied
warranties of merchantability, fitness for a particular purpose, or non-infringement. This presentation is for informational
purposes and may not be incorporated into a contract. SAP assumes no responsibility for errors or omissions in this
presentation, except if such damages were caused by SAP’s intentional or gross negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially
from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only
as of their dates, and they should not be relied upon in making purchasing decisions.
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 4 Public
Agenda
What is capture and replay?
General introduction to the functionality
When should capture and replay be used?
Common use cases and sample scenarios
How does capture and replay work?
Process architecture and technical details
What features does capture and replay offer?
Details on current capabilities
What is the current roadmap for capture and replay?
Roadmap for SPS12 and beyond
-
Public
What is capture and replay?
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 6 Public
What is capture and replay? Current features & product benefits
Features
• Capture real system workload in production environments
• Pre-process & replay captured workload on target systems
• Analyze runtimes and compare performance
Benefits
• Provides competitive replay and analysis for SAP HANA database
• Helps ensure that landscape changes do not degrade system
performance
• Enables real simulation of workload without the use of other 3rd
party tools
• Reduces manual effort for testing changes in customer
deployments
2
3
4
1
-
Public
When should capture and
replay be used?
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 8 Public
When should capture and replay be used? Common use cases
Hardware
Changes
Table
Distribution
Changes
.ini File
Changes
Index
Changes
Partitioning
Changes
Performance
Checks
Stability
Checks
Software
Updates
Design Changes Upgrades/Updates Standard Checks
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 9 Public
When should capture and replay be used? Common scenarios
Design Changes
• Can be more or less complex
depending on customer
landscape
• Can have side effects in
specific scenarios that might
require further analysis
• Might require longer periods
of time when re-distributing
tables or re-partitioning of
large tables
Upgrades/Updates
• Include downtime of systems
for upgrade, installation or
restart
• Load generated on production
system can be quite large
• Testing of different
configurations might require
high manual effort
Standard Checks
• Mandatory process for many
customers
• Can have substantial effects
on migration/upgrade strategy
• Beneficial for different areas
such as operations,
administration and
development
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 10 Public
When should capture and replay be used? End-to-end sample scenario
Upgrade
Hardware Change
Other Changes
Find Regressions
Compare Runtime
Hotspot Analysis
Varying Results
Tuning/Rewriting
Repeat “Replay
Workload”
Analyze SQL Analyze Workload / SQL Analyze Workload
Apply
Changes
Capture &
Analyze
Workload
Compare
Workload
Replay
Workload
Identify
Issues
Resolve
Issues
Source System Target System
-
Public
How does capture and replay
work?
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 12 Public
SAP HANA
Revision XXX
App Servers
Production System
Clients
Initialization
of test system
Connection via
SQLDBC
How does capture and replay work? Process architecture
Test System
Replay Service Replay Files
Replay and analyze
workload in similar
execution order, with
similar concurrency
and load distribution
3 REPLAY
4 ANALYZE
SAP HANA
Revision YYY
2
3
4
1
DB Backup
Capture Files
Capture
incoming
SQL
statements
1 CAPTURE
Capture Files
DB Backup
App Servers
Simulation Tools
Reformat &
reorder SQL
statements
2 PRE-PROCESS
Manual copy
of data
Manual
backup after
starting
capture
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 13 Public
SAP HANA
Revision XXX
App Servers
Production System
Clients
Initialization
of test system
Connection via
SQLDBC
How does capture and replay work? Process architecture
Test System
Replay Service Replay Files
Replay and analyze
workload in similar
execution order, with
similar concurrency
and load distribution
3 REPLAY
4 ANALYZE
SAP HANA
Revision YYY
2
3
4
1
DB Backup
Capture Files
Capture
incoming
SQL
statements
1 CAPTURE
Capture Files
DB Backup
Reformat &
reorder SQL
statements
2 PRE-PROCESS
Manual copy
of data
Manual
backup after
starting
capture
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 14 Public
How does capture and replay work? Captured APIs
IndexServer
XS Classic (XSEngine)
XS Advanced
JDBC / ODBC / JS DBAPI
Applications … (e.g. HANA Cockpit 2.0)
SAP NetWeaver
DBSL
S/4HANA, ERP, BW, Fiori, …
Lumira
Analysis Office 1.x
Design Studio
JDBC / ODBC
Session Layer
SQL Interface
Fiori (XSC-based)
Analysis Office 2.x
HTTP / InA
XSDBC
SAP HANA Platform
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 15 Public
How does capture and replay work? Pre-processing details
• Optimized to reduce
overhead when capturing
• Multi-level compression
added to reduce file size on
disk
• One file collected for each
service process running on
SAP HANA database
• Options to include special
information (plans, etc.)
• Reformats data representation
to optimize for replay by
Replay Service
• Reorders workloads based on
sessions
• Gather information on size,
context and timing for Replay
Service
• Session-based
structure
• Statements ordered by
execution timestamp
• No compression
• Include information on
query runtimes, etc.
Capture Files Replay Files Pre-processing
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 16 Public
…
ReplayLoader
Threads
How does capture and replay work? Replayer Service architecture overview
HA
NA
SQ
L In
terfa
ce (S
QLD
BC
)
SAP HANA
(Target System)
Logon Secure
Store
RequestDispatcher
Replay Files
RLWorker
threads
incrementally
load Replay
File
1 LOAD
RequestE
xecuto
rs =
Repla
yerS
essio
ns
replay time (ms)
RLWorker
threads fill
RequestInfo
queue
2 FILL QUEUE
Currently
sleeping
Just woke by
RequestDispatcher
logical time (ms)
Executing
Replayed
Running
Loaded
Empty
RequestDispatcher
controls
execution/wait based
on logical time
3 CONTROL Execution
RequestInfo queue #1 / Session #1
RequestInfo queue #2 / Session #2
RequestInfo queue #3 / Session #3
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 17 Public
…
ReplayLoader
Threads
How does capture and replay work? Replayer Service architecture overview
HA
NA
SQ
L In
terfa
ce (S
QLD
BC
)
SAP HANA
(Target System)
Logon Secure
Store
RequestDispatcher
Replay Files
RLWorker
threads
incrementally
load Replay
File
1 LOAD
RequestE
xecuto
rs =
Repla
yerS
essio
ns
replay time (ms)
RLWorker
threads fill
RequestInfo
queue
2 FILL QUEUE
Currently
sleeping
Just woke by
RequestDispatcher
logical time (ms)
Executing
Replayed
Running
Loaded
Empty
RequestDispatcher
controls
execution/wait based
on logical time
3 CONTROL Execution
RequestInfo queue #1 / Session #1
RequestInfo queue #2 / Session #2
RequestInfo queue #3 / Session #3
-
Public
What features does capture
and replay offer?
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 19 Public
What features does capture and replay offer? Full integration with HANA Cockpit
• Capture and replay is fully integrated with SAP HANA Cockpit
• The tile set includes one tile for capturing workload and one tile for pre-processing and replaying workload
on a target system
• Tiles provide overall status information
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 20 Public
What features does capture and replay offer? Capturing workload
• New captures can be configured via SAP Fiori-based UI
• Filters include Database User, Statement Types,
Application Name, Application User Name or Schema
Name and more
• Detailed information is provided for each capture
• Capturing process can be monitored via UI
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 21 Public
What features does capture and replay offer? Pre-processing workload
• Pre-processing can be triggered via the SAP
Fiori-based UI
• All capture files from one system can be
selected for pre-processing
• Detailed information is provided for each
pre-processed capture
• Replay can be triggered from details
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 22 Public
What features does capture and replay offer? Replaying workload
• Replay can be triggered from pre-processing
details or replay list
• Replay Service information and target
instance information need to be provided
• Detailed report for runtime analysis is
available after replay
• Replay can be monitored from UI
-
Public
What is the current roadmap
for capture and replay?
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 24 Public
This is the current state of planning and may be changed by SAP at any time.
Today Future Direction Planned Innovations
What is the current roadmap for capture and replay? Current and future innovations
SAP HANA SPS12
Basic functionality
Capturing, preprocessing, and replaying
of workload
Filtering of captured data
Replay rate control
Per-query execution time comparison
HANA Cockpit integration
SAP Fiori-based UI
Separate Delivery Unit deployment
Advanced features
Fully Transaction-consistent replay
Result-based comparison, number of
rows and return code
Rolling window capture capabilities
Flexible comparison of replays
Additional features for exporting reports
Integration with SAP HANA
performance management tools
Integration with Workload Analyzer
Integration with SQL Analyzer
Advanced features
Overhead minimization in capture,
preprocess, and replay
Additional reporting information (i.e.
lock/wait times)
Sophisticated workload manipulation
Improved monitoring capabilities for
capture and replay
Stress testing
Workload generation (i.e. additional users)
3rd party tool integration (i.e. script
language support)
Integration with SAP HANA performance
management tools
• Workload tuning suggestions
• SQL plan tuning suggestions
-
Public
Introduction to SAP HANA
Hybrid Cloud Service for
capture and replay
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 26 Public
SAP HANA
Revision XXX*
App Servers
Production System
SAP HANA Hybrid Cloud Service for capture and replay Process Architecture
DB Backup
Capture Files
Create new
workload
capture
Create
full database
backup
Secure data
shipping to
SAP
datacenter
managed by
SAP
Setup
1 Replay
2 Report
3
SAP HANA Enterprise
Cloud
SAP HANA Cloud Platform
Setup, replay,
reporting,
support
managed by
SAP
Clients
1
2
3
Administration Application
Monitor Report
* minimum release level SAP HANA SPS12 required
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 27 Public
SAP HANA Hybrid Cloud Service for capture and replay Benefits
Reduced risk for
customers
Reduced risk when applying system changes
Faster productive system upgrade
Simplified maintenance planning for IT landscape
Reduced effort for
customers
Lower amount of manual testing required
Testing and maintenance managed by SAP IT
Support process handled by SAP
Reduced cost for
customer
No additional hardware required for second system
Reduced costs for maintenance
Reduced costs for testing
Beta Program
SAP HANA Hybrid Cloud
Service
SAP is planning to offer a
closed Beta program for the
SAP HANA Hybrid Cloud
Service, starting in Q4 2016.
Customers who are interested
can reach out to SAP Capture
and Replay Cloud Service to
evaluate potential
participation*.
*participation is not guaranteed
and will be evaluated by SAP on
a per-customer basis
mailto:[email protected]?subject=Beta Participation - SAP HANA Hybrid Cloud Service for capture and replaymailto:[email protected]?subject=Beta Participation - SAP HANA Hybrid Cloud Service for capture and replay
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 28 Public
SAP TechEd Online
Continue your SAP TechEd
education after the event!
Access replays of
Keynotes
Demo Jam
SAP TechEd live interviews
Select lecture sessions
Hands-on sessions
…
http://sapteched.com/online
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 29 Public
Further information
Related SAP TechEd sessions:
ITM105 – Tools for HANA Operations (Lecture)
ITM160 – SAP HANA Database Operations: Beginner (Hands-on)
ITM361 – SAP HANA Database Operations: Advanced (Hands-on)
SAP Public Web
Introduction to SAP HANA capture and replay @scn.sap.com
SAP HANA Hybrid Cloud Service for capture and replay @hana.sap.com
Capture and replay @hana.sap.com
scn.sap.com
www.sap.com
SAP Education and Certification Opportunities
HA100 – SAP HANA Introduction
HA200 – SAP HANA Operations & Administration
www.sap.com/education
Watch SAP TechEd Online
www.sapteched.com/online
http://scn.sap.com/docs/DOC-73600http://scn.sap.com/docs/DOC-73600http://scn.sap.com/docs/DOC-73600https://blogs.saphana.com/2016/05/25/join-the-hybrid-data-management-services-beta-program/https://hana.sap.com/capabilities/admin-ops.htmlhttp://scn.sap.com/welcomehttp://www.sap.com/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/http://www.sap.com/educationhttp://www.sapteched.com/online
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 30 Public
Please complete your
session evaluation for
DMM107
Contact information:
Lucas Kiesow SAP HANA Product Management [email protected]
Feedback
mailto:[email protected]
-
© 2016 SAP SE or an SAP affiliate company. All rights reserved. 31 Public
© 2016 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate
company) in Germany and other countries. Please see http://www.sap.com/corporate-en/about/legal/copyright/index.html for additional trademark information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its
affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and
services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as
constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop
or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future
developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time
for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-
looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place
undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
http://www.sap.com/corporate-en/about/legal/copyright/index.htmlhttp://www.sap.com/corporate-en/about/legal/copyright/index.htmlhttp://www.sap.com/corporate-en/about/legal/copyright/index.html