ODTÜ TEKNOKENT SAP Startup Focus Program - Bulut Altıntaş

ODTÜ TEKNOKENT

SAP Startup

Focus Program

SAP LeonardoBulut Altıntaş

Bi-Modal IT

Mode 2 Intelligently connect people, things, and businesses

Differentiate Businesses

Mode 1Hyper-automate business processes

Run Businesses

Data Foundation

Embrace Data

Orchestrate data of any volume, velocity, and variety

Business Intelligence

Deliver insights to drive strategic decisions

Steer Businesses

connecting people, things, and businessesIntelligently

Integration Mobile

Collaboration

Big Data

Business process

innovation

Connected data

Design thinking

Microservices

APIs

Real-time

analytics

Natural

language

IoT NetworksMachine

learning

Experiences

Blockchain

4INTERNAL© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP’s Digital Innovation System

Business

Process

Business

Data

Innovatewith focus on business

priorities, processes, people

Integratenext-gen technologies into

business processes

Scalefrom departmental projects to

enterprise-wide transformation

the only systematic approach to digital innovation that

transforms at scale with minimal risk and disruption

Digital Core


SAP Leonardo


SAP Leonardo Connected Categories

SAP Leonardo IoT Bridge

Fixed Asset Insights

Manufacturing Execution

Manufacturing Networks

Mobile Asset Insights

Logistics Safety

Logistics Networks

Building Insights

Construction

Energy Grids

Market Insights

Rural Areas

Urban Areas

People and Work

People and Health

People and Homes

Connected

AssetsConnected

FleetConnected

InfrastructureConnected

MarketsConnected

People

Product Insights

Goods and Equipment

Supply Networks

Connected

Products

SAP Leonardo Foundation

SAP Cloud Platform / SAP HANA Platform

SAP Leonardo Edge

SAP Leonardo IoT


SAP LeonardoTechnologies

Internet of Things

Big Data

Data Intelligence

Blockchain

Analytics

Machine Learning

Internet of Things

IoT Applications

SAP Leonardo Bridge

IoT Services

Internet of Things

Connected

Products

Connected

MachinesConnected

Fleet

Connected


Markets

Connected

People

• Edge Services

• App Enablement

• Thing management

• Integrated & extendable suite

• Real-time view of connected things

• Built on business processes

SAP Leonardo Digital Innovation System


SAP Cloud Platform Internet of Things

Develop, customize and operate IoT applications in cloud

Application

Enablement API

SAP Cloud

Platform IoT

Internet

Gateway

Things

Any Device ready for infinite

number of Domain or Vendor

Specific Protocols

KEY CAPABILITIES

• Lifecycle management at scale for devices from onboarding to decommissioning

• Securely connect to remote devices over a broad variety of IoT protocols

• Collect and process sensor data at scale already at the edge or in the cloud and store it

on SAP Cloud Platform for your IoT applications

• Easily develop new IoT applications and services by consuming open standards based

APIs offered by SAP Cloud Platform Internet of Things

BENEFITS

• Future-proof your applications by decoupling the technology specifics through a rich

semantic data model

• Enterprise-grade performance: scalable ingestion of IoT data, broad device connectivity

and full stack security from the edge to the cloud

• Natively integrated with the comprehensive set of SAP Cloud Platform Services (e.g

Integration, Analytics, Mobile, Fiori UX, etc.)

Enhancing SAP Cloud Platform IoT to deliver more productivity and broader

device support.Applications on

SAP Cloud Platform


SAP Leonardo Internet of Things capabilities

Full stack of IoT solutions and technologies


Connected

ProductsConnected

AssetsConnected

FleetConnected


MarketsConnected

People

SAP Leonardo IoT Foundation

SAP Leonardo IoT Edge

Streaming

Persistence

Business transactions

Predictive and machine learning*

Analytics*

on SAP Cloud Platform


Technical Services

Device management

Connectivity

Messaging

Data Management

Aggregate store

Times series store

Data archive

Business Services

Thing model (SAP Digital Twin)

Application development

Reuse UI and APIs

*Planned Service


SAP Leonardo Edge Computing

Streaming

Persistence



Analytics*

SAP Leonardo for IoT Innovation Portfolio

Full IoT solution and technology stack


Connected

ProductsConnected

AssetsConnected

FleetConnected


MarketsConnected

People



*Planned Service

Data Management

Aggregate store

Times series store

Data archive

Business Services



Reuse UI and APIs



Technical Services

Device Management

Connectivity

Messaging


SAP Cloud Platform

Business Services CommerceLocalization/

TaxData Quality

Platform Services Integration Analytics Mobile IoT

(Big) Data Services:

SAP HANA

SAP ASE Redis

PostgreSQL MongoDB

Data & Storage

ServicesAltiscale/Hadoop

SAP Vora2

SaaS

SAP S/4HANA

SAP SuccessFactors

SAP Hybris Cloud for Customer

SAP Ariba

Concur

SAP Fieldglass

SAP Business ByDesign

1) BETA , 2) planned innovations / future direction

Collaboration Security UXMachine

Learning

…

SAP Web IDE /SAP API Business Hub

Cockpit Marketplace

Development Operations Commerce

Virtual Machines

Dev / OpsProgramming

models

HTML5

XSJS/XSA

Java

Node.js

Python

Community

buildpacks

SAP Cloud Platform

Capabilities of the SAP Cloud Platform

On-Premise /

Managed

Cloud

SAP S/4HANA

SAP Business Suite

SAP Business

Warehouse 1 2

SAP Leonardo



Architecture Overview

SAP Cloud Platform

CF (PaaS)

IoT service

Device

DeviceIoT Gateway

Cloud

IoT Gateway

Edge

IoT Message

Management

ServiceIoT Core Service

IoT Service

Cockpit

Cloud Protocols

HTTP / MQTT

IoT

Application

R

R

IoT Admin

IoT Application User

Send and receive

messages

R

R

R

R

Platform Service

(e.g.,

PostgresSQL,

HANA, Kafka)

Edge Protocols

such as:

HTTP, MQTT, File,

CoAP, SNMP, OPC UA,

Modbus, Sigfox

(continuous integration of

further protocols)

R

Eclipse

Plug-InIoT Gateway SDK

IoT Gateway

Adapters HTTP

MQTT

File

SNMP

Modbus OPC UA

CoAP Sigfox



Protocols via IoT Gateway Adapters

HTTP1

Zigbee

XBee

ZWave

6lowPAN

BT & BTLE

WiFi & LPWiFi

IEEE 802.15.4

MQTT1

CoAP

TR069

SNMP

HART & W-HART

SIGFOX

Semtech LoRa

NWAVE UnB

DDS

BACNET

LON

KNX

Modbus

Profibus

Infibus

DLMS/COSEM

KSAT (Viasat)

PLC(*)

OPC UA

OMA LWM2M(*)

Active Message

SWAP(*)

XMPP

LoRa

File

ProtocolsAgora Energy

Agulla

AnyDATA

Arduino

Asoka

ATIM

Axible

AXIS

B&B Electronics

CalAmp

Cisco

CloudGate

CPL

Cradlepoint

Dell

DiGi

Digicom

VendorsDistech Controls

E-Senza

Ekahau

Elster

EPISENSOR

Eurotech

Honeywell

Intenses

ITRON

Kamstrup

LIBELIUM

Marvell

MeterSit

MICRON

Mobile Devices

Morey Corp.

NaelBox

Netcomm Wireless

NETVOX

NWAVE

Orbiwise

Packet Power

PARADOX

PIKKERTON

Pulsar

Radiocrafts

RaspberryPI

Schneider Electric

Semtech LoRa

Sensinode

SIERRA WIRELESS

SIGFOX

SimpleHomeNet

SITEC

SmarteoWater

SMARTEX

ST Micro

Sterela

Telecom Design

TELIT

TekPea

TRIDIUM

VIASAT

WAGO

Wi-NEXT

Worldsensing

XIRGO

1 – also device cloud, *: Limited implantation (bold = GA)

Eclipse Plugin for New Protocols Templates for USB, Serial, API, or Network Based

Check for updates



SAP Leonardo Edge Services


Connected

ProductsConnected

AssetsConnected

FleetConnected


MarketsConnected

People



Technical Services

Device Management

Connectivity

Messaging

*Planned Service

Data Management

Aggregate store

Times series store

Data archive

Business Services



Reuse UI and APIs



Streaming

Persistence



Analytics*


SAP Edge Services

Edge Cloud

Devices

Edge

Cloud

SAP Cloud Platform

SAP Edge Services

Persistence

Service

Streaming

Service

Business

Essential

Functions

Service

IoT Gateway Edge *

Persistence

Service

Streaming

Service

Business

Essential

Functions

Service

Persistence

Service

Streaming

Service

Business

Essential

Functions

Service

Thing Thing Thing

SAP Cloud Platform IoT service *

SAP Edge Services

Policy Service

Persistence

Service

Streaming

ServiceBusiness Essential

Functions ServicEdge Services are micro

services which can be

deployed on edge

computing devices.

These services are

provided within a secure

run-time environment

ensuring:

Lifecycle management

Communication to

Things via protocol

adaptors

Integration to SAP

Cloud Platform

IoT Gateway Edge IoT Gateway Edge

* Note: SAP Cloud Platform IoT service may be abbreviated as

SAP Cloud Platform IoT. SAP Cloud Platform IoT Gateway

Edge may be abbreviated as IoT Gateway Edge.


SAP Edge Services

Policy Service

Released

Planned

Persistence

Service

Streaming

Service

Business

Essential

Functions

Service

Predictive

Analytics

Visual

Analytics

Machine

Learning

IoT Gateway Edge

IoT Gateway Hardware

Devices

Edge

Cloud

Policy Service is a component of the SAP

Edge Services offering

Deployed in the SAP Cloud Platform

(Cloud Foundry)

Provides deployment and lifecycle

management of edge service

Serves as a central repository of policies

(configurations)

Manage policies for individual and groups

of edge gateways

Thing Thing Thing

SAP Cloud Platform

Policy Service

SAP Cloud Platform IoT



SAP IoT Application Enablement


Connected

ProductsConnected

AssetsConnected

FleetConnected


MarketsConnected

People


Streaming

Persistence



Analytics*



Technical Services

Device Management

Connectivity

Messaging

*Planned Service

SAP IoT Application Enablement

Data Management

Aggregate store

Times series store

Data archive

Business Services



Reuse UI and APIs



What’s Included with SAP IoT Application Enablement?

APIs to setup, configure,

populate, maintain and store

IoT and Big Data as well as

authorization access and

event management

User Interface Applications

act as a front-end to much of

the functionality delivered via

the APIs - including thing

modelling, authorization and

business partner relationships

IoT Application Template

for WebIDE to rapidly

prototype IoT Applications

that can be easily extended

from the generated source

code


IoT Sensor Data Flow & Storage – Runtime

Application Architecture

Ingestion Pipeline

Device Connectivity

and Management

Transformations Spark Job

Big Data Store

Warm Store

Cassandra

Hot StoreHANA

Cold StoreS3/Swift

Vora

Event Service Thing Data Service

Conversions & calculated values

Derived events

Derived KPI’s

Derived events based on KPI’s

IoT Applications

Message Broker Kafka


Predicted LossPreemptive Service

Part: $ 273.90

Cost Savings: $ 120.53

Maintenance RequiredService: IMMEDIATELY

LifeX: 18 months

Replace: -5 months

Remote SensorUptime: 99.9993%

Excellent

High HumidityAH: 15 g/m3

102° F (+6.5°)

Energy Use1,073 kWh/yr

+0.1-0.2 (>range)

Thing Data

Business partners

Location

Master data

Status

Files/documents

27/631

28/631

29/631

Time Series and Events

Measurements

Thresholds

Quality codes

Typed events

Correlations

Thing Connectivity

Secure onboarding

Thing Packages

Flexible usage in different applications

Thing configurations

Thing metadata

Thing types

Property set types

Thing Hierarchies

Structure

Hierarchy

Relationships

Thing Access

Organization

User groups

Authorization

Roles


Enable applications with automated, dynamic data storage

Cold storage

Object storage (SWIFT)

Individual data points of time-

series data

High-latency access

Retention period: multiple years

Hot storage

SAP HANA for time

aggregates, that is, AVG,

MAX, MIN over 120-second

intervals, hours, weeks

Covers majority of

visualization and reporting

needs (that is, dashboard,

multiday charts, and so on)

High-performance, flexible

selections with full SQL

Warm storage

Short term: Cassandra, midterm: SAP

VORA

Individual data points of time-series data

High-performance access on single

objects and updates possible

Retention period: multiple months


Rapid app development by

professional developers (high control)

Supports SAP technologies (Fiori, IoT,

big data, HANA, CDS, OData, … )

and open-source (JS, Node.js, Java)

Full-stack (database to UI) design,

development and deployment

Zero administration cloud-based tools

SAP Web IDEFor full-stack multi-cloud application development

Code free application development


IoT Developer Experience

Development Time

Device Connectivity

& Management

Composite

Service

Thing Model

Big Data Store

Web IDE

Project

TemplatesUI Builder UI Controls

IoT Thing Modeler

Device

Models

Thing

Model

Analytics

& Rules

IoT App

UI Components

Services

SAP Leonardo Machine Learning



Internet of Things

Big Data

Data Intelligence

Blockchain

Analytics

Machine LearningMachine Learning

• SAP Cash Application

• SAP Brand Impact

• SAP Service Ticketing

• SAP Fraud Management

• SAP Customer Retention

• Document Feature Extraction

• Image Feature Extraction

• Time Series Change point Detection

• Time Series Forecast Translation

• Image Classification

Applications

Services

Conversational UI

• Conversation AI Framework

• SAP CoPilot

Machine LearningSAP Leonardo Digital Innovation System


Reimagine your value chain with Machine Learning

• Trend Analysis

(Face, Age, Gender,

Emotion, Apparel)

• Personalized Design

Design

• Learning Recommender

• Synchronous Translation

of training content

• Career Path Recommender

Human Resources

• Predictive Maintenance

• Quality Inspection

• Optimal Planning &

Scheduling

Operations

• Cash Application

• Accounts Payable

• Remittance Advices

• Predictive Accounting

• SAP Business Integrity

Screening

Finance

• Image-based Purchasing

• Goods & Services Classification

• Supplier Risk Assessment

Inbound Logistics

• Routing Optimization

• Supply Chain Resilience

• Last-mile Delivery

Outbound Logistics• Brand Impact

• Social Media Analysis

• Customer Behavior

Segmentation

Marketing

• Conversational AI

• Service Ticketing

• Customer Support

• Solution Recommender

Sales & Service


SAP Leonardo Machine Learning Strategic Partnerships

Study & formulate best practices on AI tech,

Advance the public’s understanding of AI,

Serve as an open platform for discussion

and engagement about AI,

and its influences on people and society

SAP accepted as partner

Enables one global answer

to ML & AI ethics

SAP ML in Nvidia CEO Keynote

Access to latest pre-release

hardware (e.g. DGX station)

Open-source software library for

Machine Intelligence

Our standard ML framework

(ease of training, enablement)

Partners Focus Areas Achievements


SAP Leonardo Machine Learning enables the intelligent enterprise

76% of the world’s

transaction revenue

25 industries

12 lines of business

The world’s largest

business network

Data

Science

Platform

Intelligent Apps

Intelligent

Services

In-Database

ML

Re-imagine business

processes with digital

intelligence

Increased customer

satisfaction with

superior service

Increase revenue with

superior sales targeting

and execution

Improving quality time

at work for employees

Enabling product,

process & business

model innovations

Business OutcomesSAP LeonardoMachine Learning &

Conversational AI


SAP Leonardo Machine Learning : Portfolio of Capabilities ( High Level )

Data Science Platform

giving data scientists and

business analysts tools to

build machine learning

models

In-Database Machine Learning

giving developers, data

scientists, and IT departments

the platform needed to build

intelligence into their IT

landscapes.

Machine Learning Services

enabling developers to quickly

build intelligence into their

applications and business

processes.

Intelligent Applications & Machine Learning Extensions

addressing specific business problems by lines of business

Develo

per

Data ScientistEnd-User


INTELLIGENT APPS

How does SAP enable the Intelligent Enterprise?

DEVELOPER,

DATA SCIENTIST

BUSINESS ANALYST,

CITIZEN DATA SCIENTIST ML

SK

ILL

S

# O

F U

SE

RSM

OD

E 1

MO

DE

2

PAL, APL,Graph, Text,

Streaming, PAI

Open Source & 3rd Party Machine Learning

(R, Python, TensorFlow, Spark ML, Hadoop)

Machine Learning Cloud Services

SAP Predictive Analytics

3rd Party Analytical Tools

Embedded Intelligence(S/4, SAC,

Hybris)

New Intelligent Applications


Experience SAP Leonardo

Machine Learning

SAP

Leonardo

Machine

Learning

Foundation

SAP

Customer

Retention

SAP

Service

Ticket

IntelligenceSAP Brand

Impact

SAP Cash

Appli-

cation

SAP

Accounts

Payable

SAP

Remittance

Advice

SAP

Resume

Matching

SAP

Learning

Recom-

mender

FrontOffice

BackOffice


Machine learning is embedded across the SAP portfolio

Finance

Marketing

Sales

Service

Human Resources

Procurement

Supply Chain

Platform

SAP Cash Application SAP Accounts Payable Predictive accounting …

…SAP Brand Impact Customer behavior segmentation

…

SAP Service Ticket Intelligence

SAP Customer Retention Sales forecasting

SAP CoPilot

…

…

Goods and services classifier …

Solution recommender

Profile completeness

…SAP Resume Matching Learning recommender openSAP translation

Financial advising

Forecasting (IBP) Stock in transit

Available now Wave 2 Wave 3

SAP Leonardo Machine Learning Foundation …Model training infrastructure


INTELLIGENT APPS


DEVELOPER,

DATA SCIENTIST

BUSINESS ANALYST,


SK

ILL

S

# O

F U

SE

RS

MO

DE

1

MO

DE

2


Streaming, PAI







Hybris)




- Enable Business Analysts & Citizen Data Scientists to

create predictive models through simplified approach

- Automate the end-to-end process - data preparation, model

training and model deployment are fully automated

- Ensure the output is ready to consume by business users.

- Wide range of in-database & in application scoring options to

enable deployment everywhere

- In application deployment through Predictive Analytics integrator

(PAI)

Train

model

Prepare

data

Apply

model

Capture

feedback

Intelligent Apps & ML

ExtensionsMachine Learning ServicesIn-Database Machine LearningData Science Platform

Data Manager

Automated Modeler Expert Analytics (VCF)

Predictive Factory


INTELLIGENT APPS


DEVELOPER,

DATA SCIENTIST

BUSINESS ANALYST,


SK

ILL

S

# O

F U

SE

RS

MO

DE

1

MO

DE

2


Streaming, PAI







Hybris)



Processing Services in HANAFocus on Predictive Analysis Library (PAL) - Algorithms Supported

Association Analysis• Apriori• Apriori Lite• FP-Growth• KORD – Top K Rule Discovery

Classification Analysis• CART • C4.5 Decision Tree Analysis• CHAID Decision Tree Analysis• K Nearest Neighbour• Logistic Regression• Back-Propagation (Neural Network)• Naïve Bayes• Support Vector Machine• Confusion Matrix• Parameter Selection & Model

Evaluation

Regression• Multiple Linear Regression• Polynomial Regression• Exponential Regression• Bi-Variate Geometric Regression• Bi-Variate Logarithmic Regression

Probability Distribution• Distribution Fit• Cumulative Distribution Function• Quantile Function

Outlier Detection• Inter-Quartile Range Test (Tukey’s Test)• Variance Test • Anomaly Detection• Grubbs Outlier Test

Link Prediction• Common Neighbors• Jaccard’s Coefficient• Adamic/Adar• Katzβ

Data Preparation• Sampling

- Random Distribution Sampling• Binning • Scaling • Partitioning• Principal Component Analysis (PCA)

Statistic Functions

(Univariate)• Mean, Median, Variance, Standard

Deviation

• Kurtosis

• Skewness

Statistic Functions

(Multivariate)• Covariance Matrix

• Pearson Correlations Matrix

• Chi-squared Tests:

- Test of Quality of Fit

- Test of Independence

• F-test (variance equal test)

Other• Weighted Scores Table

• Substitute Missing Values

Cluster Analysis• ABC Classification

• DBSCAN

• K-Means

• K-Medoid Clustering

• K-Medians

• Kohonen Self Organized Maps

• Agglomerate Hierarchical

• Affinity Propagation

• Gaussian Mixture Model

• Latent Dirichlet Allocation (LDA)

Time Series Analysis• Single Exponential Smoothing

• Double Exponential Smoothing

• Triple Exponential Smoothing

• Forecast Smoothing

• ARIMA / Seasonal Arima

• Brown Exponential Smoothing

• Croston Method

• Forecast Accuracy Measure

• Linear Regression with Damped Trend and Seasonal Adjust

• Test for White Noise, Trend, Seasonality


Tabular Image & Video Text Speech & Audio Business Services

General

availability

Time series change point

detection

Similarity scoring

Image classification

Customizable image

classification

Image feature extraction

Topic detection Ticket Intelligence -

Classification

Ticket Intelligence -

Recommendation

Alpha Multi-dimensional time

series forecasting

Univariate time series

forecasting

Product image

classification

OCR

Machine translation

Language detection

Product text classification

Text feature extraction

Road map Customizable

recommender

Multi-dimensional data

clustering

Generic classification

Generic CSV record

matcher

Customizable image

object detection

Customizable image

segmentation

Face detection

Face similarity

Human detection

Table extraction and

analysis

Visual document

language classifier

Customizable text

classification

Sentiment analysis

Named entity recognition

Sequence to Mask (S2M)

Speech to Text

Text to Speech

CV Matching

Customer Retention

Brand Impact

Intelligent Financing API

Accounts Payable

Leonardo Machine Learning Foundation


Business challenge: repair process is cumbersome

SAP Solution: SAP Leonardo Machine Learning

• A multitude of service tickets and images of broken products

• manual identification against a catalog with >40.000 products

• Using SAP Leonardo’s computer vision technology

• Algorithms mimic human vision to understand semantic concepts of images

• Comparison of broken product images with product catalog in seconds

How Machine Learning helped Swarovski to fix broken products


Image based shopping and product recommendations

Bring your own model

45CUSTOMER© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Bring your own model

Customizable Services

Custom Data Predefined Training Productive Model Serving

Deploy

model

Customized Services(such as invoice processing,

profile matching)

…and more

Applications (such as cash application)Text

Image

Video

Speech

… and more

Train

model

Prepare

data

Capture

feedback


Bring your own Model - Overview

• Train your own TensorFlow model

• Export model

• Deploy model on ML Foundation

• Create ML service, deploy on CloudFoundry

• Activate model

• Define model's resource requirements

• Call your model

• Monitor resource consumption

Part I:

Create Model

Part II:

Use Model


Bring your own Model: Deployment on SAP Cloud Platform

SAP Leonardo Blockchain



Internet of Things

Big Data

Data Intelligence

Blockchain

Analytics

Machine Learning

Blockchain

Ecosystem

Store

Build

Blockchain

• Blockchain-as-a-Service

• Value-added & application

integration services

• Apps with integrated Blockchain

already

• Distributed blockchain networks

across SAP data centers


SAP Leonardo Big Data



Internet of Things

Big Data

Data Intelligence

Blockchain

Analytics

Machine Learning Big Data

Open

Scalable

Big Data

Data Hub

• Manage, scale & govern the entire data

landscape

• Create pipelines to connect systems & data

stores

• Hybrid solution for both on-premise & cloud



Enterprise Systems

Data Discovery &

Pipelines

Orchestration &

Monitoring

Ingestion & Integration

Hadoop

Cloud Storages

ML, Predictive,…

Processing

Runtime

based on

SAP

Vora

Distributed Data Systems

SAP

HANASAP BW/4HANA

SAP S/4HANA

Enterprise App

SAP Data Hub

SAP Data Hub

Unifying Data Silos


SAP HANA Platform The data management and application platform for all applications

SAP, ISV and Custom Applications

All Devices

Database management

Web server JavaScript

Graphic modeler

Data virtualizationExtract, load, transform

and replication

Columnar store –Transaction and analytical

processing

Multicore and parallelization

Advanced compression

Multitenancy Multitier storage

Graph Predictive Search

Seriesdata

Business functions

Apache Hadoop and Apache Spark integration

Streaming analytics

Application lifecycle management

High availability anddisaster recovery

OpennessDatamodeling

Administration and security

Spatial

Text analytics

SAP Fiori® user experience(UX)

Application development Data integration and qualityAdvanced analytical processing

SAP HANA® PlatformOn premise | Cloud

Dataquality

Remote data sync


Enterprise Systems

Data Discovery &

Pipelines

Orchestration &

Monitoring


Hadoop

Cloud Storages

ML, Predictive,…

Processing

Runtime

based on

SAP

Vora


SAP

HANASAP BW/4HANA

SAP S/4HANA

Enterprise App

SAP Data Hub

SAP Data Hub

Unifying Data Silos


Distributed computing solution for business

Distributed Computing Cluster

Files

Vora

Spark

…

Files

Vora

Spark

Files

Vora

SparkAmazon S3

Microsoft

Azure Data

Lake Store*

Google Cloud

Storage*

Apache

Hadoop HDFS

MapR-FSKubernetes:

On premise and on Cloud:

Hadoop / Spark cluster

Distributed Transaction Log

Disk-to-Memory Accelerator

Data Modeler

Relational Time Series Graph Doc Store

SAP Vora

Data

SciencePredictive Business

Intelligence

Visualization

Apps

*Support planned starting from Vora 2.1 release

* *


Enterprise Systems

Data Discovery &

Pipelines

Orchestration &

Monitoring


Hadoop

Cloud Storages

ML, Predictive,…

Processing

Runtime

based on

SAP

Vora


SAP

HANASAP BW/4HANA

SAP S/4HANA

Enterprise App

SAP Data Hub

SAP Data Hub

Unifying Data Silos


Existing Systems Hadoop/Spark Cloud Storage Machine

LearningContainers

Challenges New Technologies & distributed data clusters


SAP Data Hub• Data Pipelines – flow based applications consisting of

reusable and configurable operations, e.g. ETL,

Preparation, Code Execution, Connectors

• Workflows – orchestrate processes across the data

landscape, e.g. executing data pipelines, triggering SAP

BW Process Chains, SAP Data Services Jobs and many

more.

• Governance – metadata repository of information stored

in the connected landscape. Offering discovery, profiling

and search capabilities.

Data

Lakes

Cloud Storage EDWs,

Data Marts

Enterprise

Applications

3rd Party

Data & Tools

Cloud

Applications

SAP Data Hub

Key Functions & Capabilities


SAP Data Hub

Distributed Runtime

Kubernetes Cluster

Connected Systems

SAP Integration & Open Connectivity

SAP Data Services

Data Services Job

Heterogeneous Landscapes

SAP VoraContainerized

SAP Data Hub Pipelines

Serverless infrastructure

Application

SAP HANA, XS Advanced Model

Distributed Runtime

Hadoop Cluster

SAP HANA

SDI Flowgraphs

Data Integration into SAP HANA

SAP BW

Process Chains

Data Warehousing ProcessesRemote

Orchestration

DB Engines

Scheduling

& Monitoring

Data

Pipelines

Access

Policies

Platform Services

UAA Jobs Git …

Relational Time-Series

Graph Document

Flow-based applications

Custom

Operators

Built-in

ConnectorsScripting

(JS, Python)

Templates

Data Discovery

& Profiling

3rd party and Open Source

Direct Connectivity

Storage, Messaging, APIs

SAP Data Hub Adapter

Metadata

Catalog

VORA Spark Extensions

SAP Data Hub

Architecture View


SAP DATA HUB application

SAP DATA HUB runtime

SAP Data Hub

Data Orchestration & Data Pipelines

SAP BW

SAP Data Services

Data Storage (Hadoop, S3, GCP, Azure, BDS)

Data Hub Pipelines

Big Data Cluster & Object Stores

SAP HANA

Scheduling

& Monitoring

Data

Pipelines

Access

Policies

Data Discovery

& Profiling

Metadata

Catalog

Workflow Orchestration

Enterprise Applications

Data Integration, Streaming, Messaging

Kafka

SAP Data Services

Data Pipeline

SAP BW

Process ChainSAP Data Hub

Data Pipeline

Change File

Formats

Load Data

into Data Lake

Execute Pipeline

Execute Pipeline

Listen

KAFKA

Write

HDFS

Cleanse

Data

Execute

Python Persist

Result


SAP Data Hub – Streaming and Processing IoT Data

SAP

DATA

HUB

Data Lake

SAP

VORA

SAP HANA

SAP

BOC

How to understand customer behavior

and to drive insightful decisions?

- Customer Example

Smart appliances sending sensor data

which need to be processed

~6 million devices, 16 TB data volume per

day

Solution with SAP Data Hub

• Refine business value from data ingestion to

enterprise applications

• Visual modeling environment

• Governance and Data Management

• Orchestration and scheduling to define

automated data driven processes

Cockpit Orchestration Data Pipelines

Cust.

Data

APIs.parquet

.cvs

SDA

SDI

CUSTOMER

Bulut Altıntaş

Thank you!

Partner logo


S A P H A N A P L A T F O R M

DATABASE SERVICES

SAP HANA Platform: Processing servicesComprehensive advanced data processing and analytics

Run applications with dramatically different datatype characteristics in the same system

Optimize graph, planning, and rules applications on the same data

Empower your business via built-in predictive analytics, business functions, and data

quality

Graph* Predictive Search SeriesData

Business Functions

Streaming Analytics

Spatial Text Analytics

INTEGRATION & QUALITY SERVICES

APPLICATION SERVICES

PROCESSING SERVICES


Predictive analytics

Transforming the future with today’s insights

– 70+ prepackaged predictive algorithms

▫ Supports association, clustering, classification, regression,

time series etc.

▫ Supports variety of data – structured, spatial, text, streaming

and series data

– AFM graphical modeling tool support to develop

predictive applications using PAL and R-Script

– SAP Predictive Analytics leverage Automated Predictive

Libraries (APL) libraries and PAL

– SAS processing run natively in SAP HANA eliminating

date redundancy

– Leverage R advanced functions transparently

– Predictive analytics across multiple data types

SAP HANA

Studio/Web IDE

Application Function

Modeler (AFM)

Tools &

Applications

SAP

Predictive

Analytics

S AP H AN A P L AT F O R M

Predictive Analysis

Libraries (PAL)

R Integration

Predictive

Analysis

Libraries (PAL)

Automated Predictive

Libraries (APL)


Processing Services Focus on Predictive Analysis Library (PAL) - Algorithms Supported

Association Analysis• Apriori• Apriori Lite• FP-Growth• KORD – Top K Rule Discovery

Classification Analysis• CART • C4.5 Decision Tree Analysis• CHAID Decision Tree Analysis• K Nearest Neighbour• Logistic Regression• Back-Propagation (Neural Network)• Naïve Bayes• Support Vector Machine• Confusion Matrix• Parameter Selection & Model

Evaluation

Regression• Multiple Linear Regression• Polynomial Regression• Exponential Regression• Bi-Variate Geometric Regression• Bi-Variate Logarithmic Regression

Probability Distribution• Distribution Fit• Cumulative Distribution Function• Quantile Function

Outlier Detection• Inter-Quartile Range Test (Tukey’s Test)• Variance Test • Anomaly Detection• Grubbs Outlier Test

Link Prediction• Common Neighbors• Jaccard’s Coefficient• Adamic/Adar• Katzβ

Data Preparation• Sampling

- Random Distribution Sampling• Binning • Scaling • Partitioning• Principal Component Analysis (PCA)

Statistic Functions

(Univariate)• Mean, Median, Variance, Standard

Deviation

• Kurtosis

• Skewness

Statistic Functions

(Multivariate)• Covariance Matrix

• Pearson Correlations Matrix

• Chi-squared Tests:

- Test of Quality of Fit

- Test of Independence

• F-test (variance equal test)

Other• Weighted Scores Table

• Substitute Missing Values

Cluster Analysis• ABC Classification

• DBSCAN

• K-Means

• K-Medoid Clustering

• K-Medians

• Kohonen Self Organized Maps

• Agglomerate Hierarchical

• Affinity Propagation

• Gaussian Mixture Model

• Latent Dirichlet Allocation (LDA)

Time Series Analysis• Single Exponential Smoothing

• Double Exponential Smoothing

• Triple Exponential Smoothing

• Forecast Smoothing

• ARIMA / Seasonal Arima

• Brown Exponential Smoothing

• Croston Method

• Forecast Accuracy Measure

• Linear Regression with Damped Trend and Seasonal Adjust

• Test for White Noise, Trend, Seasonality


R integration

Use leading open source data mining software transparently

– Embed R script within SQL script

– Execute R script inside R server

– Use R vector-oriented format rather

than JDBC/ODBC

– Execute multiple R processes in parallel

– Leverage 3,500+ R statistical and

graphical packages

R Server

R Process

R-code

Input data in R Format

Results in R Format

Query Processor

R Client



Spatial processing

New insights from enriching business data with spatial data

– Store and process spatial data with other data types

– No need to create spatial indexes, tessellation, etc.

– Support open standards compliance (Open Geospatial Consortium -

OGC)

– Spatial data types

▫ Points, lines, polygons

▫ Multi-dimensional support including 3D and measurement dimension

– Spatial functions

▫ Area, distance, within, touches, intersects, adjacent

– Built in geo-content

▫ Maps, political boundaries, roads, Point of Interests (POI)

– Spatial join operators for SQL and Calculation Views

▫ Contains, crosses, intersects, overlaps, touches, within

▫ Automatically add latitude and longitude to address


External Geocoding Services

Spatial FunctionsSpatial Data Types

Maps & POIGeocoding

Spatial Engine


Graph engine

New insights from diverse data without data duplication

– Manage property graphs within flexible, in-memory

columnar store – faster queries and less storage

– Combine graph with advanced analytics – text, predictive,

geospatial – in a single transaction

– Offer GEM language to traverse and manipulate graphs

– No data duplication to create graphs


Graph Engine

Shortest PathNeighborhood

Search

Pattern MatchingStrongly Connected

ComponentsReha Cronus

HeraZeusAtlas

Maia Danae ApolloHermes

ArtemisPleione Leto

10.8

1

0.5 0.9

Zeus

Athena Hermes Atlas

Maia

a b c d

e f g hrel=parentof

name=Zeus

V1 V2

V1 V2

V3

rel=punish

Who has punished whom

Who has punished whom


Search, text analytics and mining

Insights from unstructured data

– Store text and binary files in SAP HANA for native text analysis and search

– Support various file formats(txt, html, xml, pdf, doc, ppt, xls, rtf, msg)

– Automatically detects 31 languages

– Search

▫ Fuzzy, linguistic, synonymous search, using SQL

– Text Analytics

▫ Extract relevant information from text

(Linguistic Markup, Entity, Sentiment Extraction)

– Text Mining

▫ Rank and Categorize documents by comparing with a set

of pre-classified documents

Search Engine

Text Analytics

Linguistic Processing

Entity, Fact Extraction

Text Mining



Streaming Analytics

Streaming and business data combined for real-time action

– Capture, filter, analyze, and act on millions of

events per second in real-time

– Capture high value data in SAP HANA and

direct other data into Hadoop

– Stream live information to operational

dashboards

– Light-weight stream processer “Streaming Lite”

for devices and IoT gateways to preprocess and

alert

– Perform continuous queries using declarative

(CCL) or model-driven approaches

– Run predictive algorithms (Adaptive Hoeffding

Tree and DenStream) on streaming data

Stream

(Push)

Streaming Service

Incoming Streams

Devices/IoT

Gateway

Streaming

LiteS AP H AN A P L AT F O R M

ODTÜ TEKNOKENT SAP Startup Focus Program - Bulut Altıntaş

Education

Transcript of ODTÜ TEKNOKENT SAP Startup Focus Program - Bulut Altıntaş