SAP HANA SPS09 - Hadoop Integration
Click here to load reader
-
Upload
sap-technology -
Category
Technology
-
view
1.783 -
download
2
description
Transcript of SAP HANA SPS09 - Hadoop Integration
1 © 2014 SAP AG or an SAP affiliate company. All rights reserved.
SAP HANA SPS 09 - What’s New? Hadoop Integration
SAP HANA Product Management November, 2014
(Delta from SPS08 to SPS09)
3 Public © 2014 SAP SE or an SAP affiliate company. All rights reserved.
Key Themes for SAP HANA SPS09
The Platform for All Applications
Availability Flexibility Reliability
Cloud Big Data & IoT Next Gen Apps Openness
Hardware, software, and cloud
infrastructure flexibility, options,
and openness for faster ROI
Accelerate Innovate Simplify
Deliver real-time insights into
Big Data & IoT and provide new
advanced analytic capabilities
Streamline cloud & on-premise
deployments, data
management, and enhance
price performance options
Internal
© 2014 SAP AG. All rights reserved. 4 Internal Internal
Enhanced data virtualization and access capabilities to support the
next generation logical enterprise architecture – Analytic Data Warehouse
Enhancements
New data source: SAP MaxDB
SAP Sources: HANA, ASE, IQ, MaxDB, ESP, SQLA
Database: Teradata, Microsoft SQLServer, Oracle, IBM DB2, IBM Netezza
Hadoop: Cloudera, Hortonworks, MapR & Others
Benefits
Real-time virtualized data access to external data sources
Compliments and leverages existing enterprise investments
Leverages advanced native SAP HANA capabilities to build applications
Optimized performance and reduces objections to start in-memory journey
Lower development costs by using data directly from its source system
Innovate
Smart Data Access
© 2014 SAP AG. All rights reserved. 5 Internal Internal
Innovate
Enhanced Hadoop Integration
New and enhanced Hadoop integration for more advanced and
feature rich processing of Big Data
Virtual UDF (vUDF)
New type of User Defined Function for data federation
Direct access to HDFS without need for the package, mapper, and reducer specification
Invoke custom Map Reduce jobs
vUDF can be embedded in SQL
Use Cases & Benefits
Ability to leverage features in a Hadoop cluster other than HIVE & Spark (e.g. HDFS, MapReduce)
Ad-hoc query capabilities and processing of unstructured data
Utilize vUDF for use cases that don’t fit into the typical HIVE usage patterns via SDA
SAP HANA vUDF
Operator
RFC
Hadoop
Hadoop
Map
Reduce
HDFS
YARN
HIVE
© 2014 SAP AG. All rights reserved. 6 Internal
SAP HANA: Map Reduce/Virtual UDF – Architecture
© 2014 SAP AG. All rights reserved. 7 Internal
SAP HANA: Hadoop Integration
What’s New in SPS09
Direct access to HDFS file system from SAP HANA
Develop and invoke custom Map Reduce jobs from SAP HANA
a. SAP HANA studio as the single IDE to invoke the M/R jobs
b. Leverage HANA Repository design time for Map Reduce job, remote Hadoop source and virtual functions
c. Support of remote result caching of virtual function execution
Data Provisioning support for remote source connectivity for IM in HANA via SAP HANA Service/Adapter Framework
Support current versions of partner (Hortonworks, Cloudera etc.) Hadoop Distributions
© 2014 SAP AG. All rights reserved. 8 Internal
MR/Virtual UDF - Development Life Cycle (SAP HANA-
SP09)
Java/MR Developer
HANA modeler/administrator
Business Analyst
9 Public © 2014 SAP SE or an SAP affiliate company. All rights reserved.
Additional Important Resources for SAP HANA SPS09
SAP HANA SPS09 GTM Site
https://jam4.sapjam.com/wiki/show/v2tS6QGERlo0AlNKnTauC6
Internal
10 Public © 2014 SAP SE or an SAP affiliate company. All rights reserved.
Further Information
SAP HANA SPS09 GTM Site
https://jam4.sapjam.com/wiki/show/v2tS6QGERlo0AlNKnTauC6
SAP Public Web
scn.sap.com
www.sap.com
www.sapbigdata.com
www.sap.com/solution/big-data/software/overview.html
Thank you
Contact information
Prasad Illapani
SAP HANA Product Management