Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL...

25
Advanced Analytics Integration 2018 Financial Services Analytics Summit Pinar Celen Feb 2018

Transcript of Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL...

Page 1: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

Advanced Analytics Integration

2018 Financial Services Analytics Summit

Pinar Celen

Feb 2018

Page 2: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

Advanced Analytics

Introduction

Page 3: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

3

Qlik Sense offers native and third party capabilities

• Native capabilities include statistical functions, interactive visualizations, and scripting for

many advanced analytics use cases

• Advanced Analytics Integration offers engine-level sharing between Qlik Sense and third

party tools such as R and Python, for incorporating advanced calculation and machine

learning into analyses

Corporate

Reporting

Guided

Analytics

Ad-hoc

Analysis

Data

Visualization

Advanced

Calculations

Statistics/

Algorithms

Modeling /

Mining

Scenario

Analysis

+ Advanced Analytics Integration

Page 4: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

4

Data Acquisition

Data Preparation

Data Selection

Model Selection

Result Generation

Result Presentation

Action Steps

Model Creation

Business AnalystData Scientist Business User

Results Interpretation

The old way

Page 5: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

5

Model Creation

Governance & Oversight

Data Selection

Basic Parameterization

Result Generation

Result Presentation

Action Steps

Data Acquisition

Data Preparation

Advanced Parameterization

Automated Model Selection

Roles are changing

Business AnalystData Scientist Business User

Page 6: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

Advanced Analytics

Integration

Server Side Extensions

Page 7: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

77

Advanced Analytics Integration

• Direct integration with 3rd party advanced analytics engines through server-side extension APIs

• Allows data to be directly exchanged between the QIX engine and external tools during analysis

– Leverages Qlik’s Associative Model to pass relevant data based on user context

• Full integration with Qlik Sense expressions and libraries

• Connectors can be built for any external engines

• Open source connectors to be made available by Qlik for R and Python

Leverage the power of advanced

analytics calculations in Qlik Sense

Etc..

Page 8: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

8

What makes our approach unique

Qlik’s Associative Model working with all third party engines

• Third party engines quickly process

smaller, user-specific data sets

• Far more speed than conventional batch

techniques

• Results for each user are sent back to Qlik

Sense in real-time

• Connectors can be built for any third party

engines, through open APIs

• As the user explores, only a small set of

chosen and relevant data is sent

• Results are instantly visualized for the

user, allowing for further exploration

Page 9: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

9

How it works

1User interacts with app,

making a selection or a

search2

Hypercube recalculated

by QIX Engine to the

new context3

In-context data and

script sent to external

engine

4External engine runs

and sends results to

QIX engine5

QIX engine combines

hypercube with new

data6

Combined hypercube

Is visualized for the

user in the app

Page 10: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

10

Functional Buckets

Triggers from ETL

Triggering not only

advanced analytic

scripts/calls, but

potentially any call out to

an external system.

Think the ‘execute’

function.

Integrating functions in

ETL

Using advanced analytic

functions as a part of the

data load, e.g. sentiment

analysis or geocoding

within a record by record

load.

Front-end

This is what we primarily

market, where a user

makes a selection, the

associated data is then

sent, processed, and

returned through the

analytic connection in

real time.

Page 11: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

11

Flexibility to Fit Different Needs

Scenarios

Experience,

Infrastructure and

Processes – Visualize

Advanced analytics is

primarily done upstream

of Qlik. Qlik can trigger

processes, run data

through existing models,

and maybe find a sweet

spot for front-end use.

Some Experience but

Little Infrastructure and

Processes – Integrate

Qlik can trigger

processes, leverage

advanced analytics

functions from the front

end and ETL. Some

knowledge required.

No Real Experience or

Staff

Leverage extensions like

the AA Toolbox and the

AA Expression builder.

Page 12: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

12

SSE Overview

Page 13: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

13

SSE with R Overview

Page 14: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

Advanced Analytics

Use Cases

Page 15: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

15

Common Use Cases

Manufacturing & High Tech

• Demand Forecasting

• Quality & Machine Breakdown

• Warranty Analytics

Healthcare

• Patient Admission Forecasting

• Readmission Analysis

• Clinical Outcomes

Communications

• Customer Segmentation/Churn

• Quality/Process Control

• Next Best Offer/Action

Financial Services

• Credit Risk Analysis

• Loan Default

• Fraud Detection

Public Sector

• Crime Prevention

• Transportation Optimization

• Recidivism

Retail & Consumer

• Market Basket Analysis• Retail Store Selection• Product Recommendation

Energy & Utilities

• Customer Churn

• Proactive Failure

• Peak Demand

Life Sciences

• Territory Alignment

• Campaign Management

• Drug Discovery & Effectiveness

Page 16: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

16

Provides sophisticated

predictive analysis for both

strategic planning and day-to-

day operations

Re-adjusting hour-by-hour

forecast using underlying

algorithms

Situation Room

Page 17: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

17

Market Basket Analysis

Page 18: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

18

Clustering (R Integration)

Page 19: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

19

Customer Sentiment Analysis

Page 20: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

20

Financial Services

Fraud Detection• Leverage pattern analysis comparing customer activity

with peer group behavior

• Utilize customer’s own past behavior to identify outlying

transactions

• Bayesian learning, neural networks, fuzzy neural nets,

and combinations of neural nets and rules, have been

extensively explored

Expert knowledge is integrated with statistical power and

rule-learning programs to uncover indicators of fraudulent

behavior from a large database of customer transactionsClustering

Classification

Abnormality

Page 21: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

21

Knowing how many patients are likely to be admitted

provides a forward look on bed availability and flags

potential capacity issues in the days or weeks to come

• Qlik solution has taken customer from one of the worst

performing ER's to one of the best in the country

• All the forecasting calculations are performed inside

Qlik and get ~85% accuracy

Healthcare

Patient Admission Forecasting

Forecasting is an important aid in many areas of hospital

management, including elective surgery scheduling, bed

management, and staff resourcingClustering

Regression

Trending

Page 22: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

22

to using a sales app at

Gatorade de Mexico

Enable Credit Managers to forecast with accuracy –

understanding what factors influence credit losses, and

optimizing the credit book to minimize future losses. Clustering

Classification

Abnormality

Financial Services

Credit Loss Forecasting• Credit managers need to predict their expected future

credit losses.

• This is mandatory for regulations like iFRS9.

• Qlik’s solution enables teams to ask complex questions

without notice – and answer them in real time.

• Managers can predict the expected losses for specific

products – loans written in any region, in any time

period, filtered by employment type or credit grade.

Page 23: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

23

• Driving actionable insight from customer purchase

patterns hidden within the mountain of data

• Leverage advanced analytics and algorithms to

produce statistics like support, confidence, and lift

for a deep dive into product affinities

• Quickly consume but also allow business users to

ask the inevitable “next question” that goes

beyond simple static reporting

Data Mining technique based

upon the theory that if you buy a certain

group of items, your are more (or less)

likely to buy another group of items

Retail

Market Basket Analysis

Clustering

Association

Correlation

Retailers must understand consumer preferences and purchase

patterns to help provide more targeted offers and tailored assortments,

resulting in larger basket sizes and locking in higher margins

Page 24: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

24

Consumer

Customer Churn• Classification (Decision Tree) algorithms to segment

customers as at-risk

• Analyze different ‘What-if’ scenarios by modifying the

input variables and assess the overall impact on

customer models

• Evaluation and processing of call records for sentiment

analysis and categorization

Focus retention campaigns and deliver preferential services

to at-risk high-value subscribers who have been predicted

to have a propensity to churnAffinity

Classification

Sentiment

Page 25: Advanced Analytics Integration - Qlikgo.qlik.com/rs/497-BMK-910/images/PCL _SUMMIT-Customers.pdfAdvanced Analytics Integration • Direct integration with 3rd party advanced analytics

Thank You