DMM104_16053_HofmansB_1

Public

Subha Ramachandran / SAP / Product Management

Ben Hofmans / SAP / Product Management

DMM104 Whats New in SAP Data Services

2014 SAP SE or an SAP affiliate company. All rights reserved. 2 Public

Disclaimer

This presentation outlines our general product direction and should not be relied on in making a

purchase decision. This presentation is not subject to your license agreement or any other agreement

with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to

develop or release any functionality mentioned in this presentation. This presentation and SAP's

strategy and possible future developments are subject to change and may be changed by SAP at any

time for any reason without notice. This document is provided without a warranty of any kind, either

express or implied, including but not limited to, the implied warranties of merchantability, fitness for a

particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this

document, except if such damages were caused by SAP intentionally or grossly negligent.


Agenda

EIM and data integration portfolio at SAP

SAP Data Services 4.2 SP3

New Data Management Options in the Cloud and Embedded in HANA

Conclusion

EIM and data integration portfolio

at SAP


SAP Strategy 2014

2014 SAP SE or an SAP affiliate company. All rights reserved. 6 Public 2014 SAP AG or an SAP affiliate company. All rights reserved. 6

SAP Enterprise Information Management (EIM) Mission

Leverage SAP HANA Platform to deliver breakthrough real-time performance and

simplicity to support any data volume, variety, and delivery mode

Data integration & quality, master data management & governance everywhere on-premise, on-cloud, on-device, and hybrid

Pervasive, open and extensible on-premise and cloud source and target support structured, text, big data, social, spatial, SAP and non-SAP

Enhanced productivity for developers integrated environment, build once deploy anywhere, switch between delivery modes, and predict next-step wizards

Better value to the business smart, self-service data preparation, financial impact calculators, audit services, tight integration with industry and application offerings

4

5


SAPs Comprehensive Data Movement Capabilities

Enterprise-class solution for data integration, data quality, and text data processing that allows organizations to integrate, transform, improve, and deliver trusted data for critical business processes and accurate analytics

Integrated information governance capabilities with business-user UI for metadata management with data lineage analysis from source to report , data profiling, measuring, and assigning business impact to an organizations data quality.

Real-time change data capture (CDC) for demanding use cases, including High Availability (HA)/Disaster Recovery (DR) and real-time business intelligence

High speed, non-intrusive data replication across geographical boundaries with transactional integrity

Integrated with Business Process Management, Business Rules Management, and Process Orchestration

Cloud-based integration platform as a service (PaaS) with data and process integration capabilities

Fast, dependable system consolidation within and across releases for reducing total cost of operations

SAP Process

Orchestration

SAP Data Services &

Information Steward

SAP Replication

Server

SAP Landscape

Transformation

SAP HANA

Cloud Integration


SAP Data Services enables

users with access to any data,

abilities to transform, improve,

and enrich structured or

unstructured data, in batch or at

real-time point of entry, all via a

single solution

SAP Data Services Extract Transform and Load (ETL) & more

One Runtime Architecture &

Services

Business UI (Information Steward)

Unified Metadata

Technical UI (Data Services)

SAP Data Services

ETL

Data Quality

Profiling

Text Analytics

One Administration Environment

(Scheduling, Security, User Management)

One Set of Source/Target Connectors

SAP Data Services 4.2 SP3

Data Services Release cycle

New functionality in Data Services 4.2 SP3

Big Data

Smart and Simple

Information Governance

Whats next ?


New Release Strategy for SAP Data Services & Information Steward Increase the speed of innovation consumption through simplicity and improved UX

New innovations delivered quarterly.

No waiting period or ramp-up period.

Quick response on customers ideas and enhancement requests.

Quarterly release of innovations in 2014

SP2 (Q2 - end of May)

SP3 (Q3 - end of August)

Planned SP4 in Q4

More to come in 2015


Your channel for submitting ideas to improve SAP Data Services https://ideas.sap.com/SAPBusinessObjectsDataServices

Submit

your idea

Vote on

other good

ideas

Product

development

will review ideas

Suitable ideas

are built into a

future release


Data Services 4.2 SP3 New Features at a glance

Big Data

OData and JSON file format support (SP2)

Simplified Real-Time CDC with SAP Replication Server

Data Preview for HIVE tables in HADOOP

Geospatial data enhancement: ESRI Shapefile support

Smart & Simple

Bypass Data Services dataflows and workflows at runtime

Enhancements in the free text search


New Data Masking transform

Global Address Cleanse Enhancements (firm suppression, new locality field for Japan & China, )

Expanded geocoding coverage (SP2)


Simplified Real-Time CDC with SAP Replication Server

13

Value Proposition

Continuous capture of data changes from multiple sources to multiple targets

Rich tooling with transformation and enrichment capabilities

Automates and ease of administration

Ease of use. Rich capabilities.

Use Cases

Generate up-to-date consumer usage reports for analysis

Realtime updates from non-SAP systems to SAP HANA

How it works

Data Services connects directly to source systems for metadata information

Data Services connects to Replication Server/Agent for subscription,

configuration and changed data fetch

Direct data integration

Source DB

SAP Replication Server

(formerly Sybase Replication

Server)

Realtime business insights


Simplified Real-Time CDC with SAP Replication Server Background

Real-time CDC with Rep Server was first introduced in Data Services 4.2

Integration required use of Power Designer for Replication Agent subscriptions and ASE as external staging between Replication Server and Data Services.

In Data Services 4.2 SP3, a simplified architecture and configuration.

DS connects directly to source systems for metadata information.

DS connects directly to Replication Server/Agent for subscription configuration and changed data fetch.

4.2 SP3 only supports for Oracle. Support for other databases will be added to upcoming SP releases based upon customer demand.


Simplified Real-Time CDC with SAP Replication Server New options in datastores

For selected data stores, a new Rep Server CDC option is available.

The Native CDC options still exist for Oracle, SQL Sever and DB2. But the

new Rep Server CDC offers a uniform

CDC across database types with simple,

automated setup.

A Data Services user can configure connection with Replication Server in the

Advanced properties.


Simplified Real-Time CDC with SAP Replication Server Typical setup for initial + delta load

Initial load and delta load in the same job to have clear hand-over between initial and delta. A conditional

workflow is used to decide to do or skip initial/fresh load.

The continuous workflow will keep running in an endless loop (or until a stop condition is met, e.g. stop at 1m and

restart at 5am).

The CDC dataflow inside the continuous workflow will read the table from the CDC datastore.

In the dataflow use Map_CDC_Operation to generate INSERT, UPDATE and DELETE statements for the target

table.



Value Proposition

Unify tooling for spatial and non-spatial data loading

High performance ETL capability for importing large volume of spatial data

Supports market leading GIS

Use Cases

Enrich data analytics with spatial data

Combine spatial data integration with geocoding to enhance data quality for

global companies

Spatial data enrichment

Supports

Oracle Spatial Data Type

HANA Spatial Data Type

ESRI Shapefile Import (new adapter)

Geospatial data

17



New adapter to read ESRI Shapefiles.

Shapefile data is read a CLOB and can be mapped to HANA or Oracle geometric datatypes (e.g. ST_GEOMETRY)

source table (shapefile)

target table (HANA table)


Bypass Data Services dataflows and workflows at runtime

Value Proposition: Allows Designer users to simplify overall data integration testing.

Allows complex jobs to run with bypassing identified workflow and/or dataflow objects

Allows isolation of dataflow/workflow objects to enhance and speed up troubleshooting process

This was one of the top SAP IdeaPlace feature requests from customers.


New Data Mask Transform Why It Is Important?

Value Proposition

Safeguard critical business assets

Built data protection into existing ETL logic as one data movement process

Ease of use

Secure. Protect.

Use Cases

Randomized sensitive production data for test data management

Protect sensitive data as part of industry regulatory compliance

How it Works

Supports any data types, such as, numeric, strings, dates and so on

Provides various data protection techniques to match specific protection

requirements including masking out and

variance (by fixed number, % and range)

Direct data integration

Real-time business insights

Sensitive Data Protection Data Masking


New Data Mask Transform New Platform transform

New Data Mask transform

Platform transform

Identify Input Fields

Set masking options

Output Fields = Input Fields


New Data Mask Transform Mask Out Sensitive Data

Mask Out

Ability to mask out data with a masked out value

Supports any data types

Ability to maintain formatting

Numeric Variance

+/- Percentage

+/- Fixed Value

Random values in a range


Continued global expansion of address cleansing and geocoding

Geocoding supported added for:

Lithuania (SP2)

Luxembourg (SP2)

Estonia (SP2)

Turkey (SP2)

Total supported countries now 23.

Next: Russia, New Zealand,

Global Address Cleanse enhancements:

Added South Korea (SP2)

Additional locality field (with town/suburb information) for China and Japan (SP3)


Data Services Future Plans (DS 4.2 SP4 and beyond)

Smart & Simple

Productivity improvements


Sensitive data protection (continued expansion )

Continued global expansion of address cleansing and geocoding coverage based on market need

Big Data

Enhancements to further support HANA/Hadoop/Sybase IQ

Support new sources and targets - Google Big Query/Amazon RedShift

Enterprise Support

Robust handling of large complex structures

Improved error handling and log monitoring

Tighter integration with SAP Solution manager and CTS

FTP / SFTP adapter

New Data Management Options in

the Cloud and Embedded in HANA


SAP HANA Cloud Integration Strong customer adoption for iPaaS offering

SAP HANA Cloud Integration

Rated Visionary on Gartner Magic

Quadrant for Enterprise Integration

Platform as a Service, Jan/2014

Cloud-based technology

Combined Data integration + Real-

time process integration

Web-based user interface

Pre-packaged integration content for

rapid time-to-value

Centralized monitoring and

administration

Pre-built adapters

Community marketplace (future)

Real-Time

Process

Integration

Prepackaged

Integration flows

Community and

Marketplace

Data

Integration

SAP

On-Premise

3rd Party

On-Premise

3rd Party

Cloud Solutions

SAP Cloud Applications


Key Capabilities Key Customer Benefits Key Considerations

SAP HANA Cloud Integration for Data Services Current capabilities

Direct secure access to multiple ECC sources to extract, transform and load to

targeted cloud applications.

Read and write from heterogeneous sources databases (HANA, DB2, Oracle, SQL Server) and files (XML or delimited).

Graphical data flow editor to create complex tasks in simple way.

Role-based web UI in HTML5 to design, execute and monitor ETL jobs.

End to end visibility for data loads into the S&OP

Configurable e-mail notifications to alert on integration flow operations

Built-in scheduler or invoke integration flows from 3rd party applications through a

web service call.

Seamless and secure integration of onPremise to SAP Cloud eliminating

need to open firewall to inbound

traffic

Data never persists in SAP HANA Cloud Integration, but is piped from OP source

to target data-store in SAP cloud

Intuitive user experience for creating and editing ETL jobs without coding

Set it and forget it automated with scheduling, no manual work

Built-in version management and audit trails

Minimal on premise footprint (

Conclusion


SAPs Comprehensive Data Movement Capabilities

Rapid innovation via quarterly Data Services support packages for all data integration and data

quality management use cases.

Main areas of investment:

Big Data (Hadoop, CDC, new data sources)

Simplicity (tool harmonization, usability enhancements)

Data Governance (data masking, data quality)

Specialized solution for cloud data integration with SAP HANA Cloud Integration

Information Management services embedded in HANA for all HANA centric data integration.

Questions ?


SAP d-code Virtual Hands-on Workshops and SAP d-code Online Continue your SAP d-code education after the event!

SAP d-code Online

Access replays of keynotes, Demo Jam, SAP d-code live interviews, select lecture sessions, and more!

Hands-on replays

http://sapdcode.com/online

SAP d-code Virtual Hands-on Workshops

Access hands-on workshops post-event

Starting January 2015

Complementary with your SAP d-code registration

http://sapdcodehandson.sap.com


Further Information

SAP Education and Certification Opportunities

www.sap.com/education

Watch SAP d-code Online

www.sapcode.com/online

SAP Public Web

Community @SCN: http://scn.sap.com/community/data-services

Wiki @SCN: http://wiki.scn.sap.com/wiki/display/EIM/Data+Services

Idea Place: https://ideas.sap.com/SAPBusinessObjectsDataServices

Documentation: http://help.sap.com/bods/


2014 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an

SAP affiliate company.

SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE

(or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark

information and notices.

Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.

National product specifications may vary.

These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its

affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or

SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing

herein should be construed as constituting an additional warranty.

In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or

release any functionality mentioned therein. This document, or any related presentation, and SAP SEs or its affiliated companies strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for

any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-

looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place

undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.

DMM104_16053_HofmansB_1

Documents

Transcript of DMM104_16053_HofmansB_1