SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER...

21
Copyright © 2015, SAS Institute Inc. All rights reserved. SUPPORTING ANALYTICS THAT SCALE CONSIDERATIONS FOR A MODERNIZED ANALYTICS SANDBOX Tim Trussell and Antoni Dzieciolowski Specialists, Data Sciences, SAS Canada

Transcript of SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER...

Page 1: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SUPPORTING ANALYTICS THAT SCALE

CONSIDERATIONS FOR A MODERNIZED ANALYTICS SANDBOX

Tim Trussell and Antoni Dzieciolowski

Specialists, Data Sciences, SAS Canada

Page 2: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

• Using ALL the Relevant Data

• Creating More Attributes

• More Models

• More Granular Segments

• More Predictive Machine

Learning Algorithms

• Model Tournaments

• Enable Non-Technical

Users

• Integration

• Embedded Analytics

• Move Insights Closer to

the Decision Maker

• Combine Models with

Business Rules

DECISIONS AT SCALE

Automation

Page 3: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Data

Discovery Deployment

Iterative

Visual

Experiments

Fail Fast

Data Science

Interactive

New data

Innovation

Deep Learning

Governed

Robust

Automated

Regulated

Actions

Consistent

Documented

Decisions

Prepare

Explore

Model

Implement

Act

Evaluate

Ask

ANALYTICS

LIFECYCLESCALE OUT THE ENTIRE LIFECYCLE

Page 4: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

AT SCALE DATA

Discovery Deployment

Iterative

Visual

Experiments

Fail Fast

Data Science

Interactive

New data

Innovation

Deep Learning

Governed

Robust

Automated

Regulated

Actions

Consistent

Documented

Decisions

Prepare

Explore

Model

Implement

Act

Evaluate

Ask

Page 5: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

MANAGING

ANALYTIC DATAAD-HOC ANALYTIC DATA PREPARATION

DataWarehouse

Source Systems

Operations

Cloud

Appliance

Reporting Tools

Read

ETL

Analytics

ETL

Analytics Base

Tables

Ad

-ho

c D

ata

Ma

na

ge

me

nt

Operational

DataMarts

Page 6: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

THE CHALLENGE OF

UNSTRUCTURED

DATA

Text

A

Miracle

Occurs

Insight

Page 7: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

DEMO

Page 8: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

INSIGHT FROM

WORDS

Natural Language Processing

Context

JL

Machine Learning

H

Discovery

Human Input

Topics, Insights,Relationships, Taxonomies,

Scored Documents

Unstructured Data

~80% of Data

Operations

Further

Analysis

Page 9: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

AT SCALE EXPLORATION

Discovery Deployment

Iterative

Visual

Experiments

Fail Fast

Data Science

Interactive

New data

Innovation

Deep Learning

Governed

Robust

Automated

Regulated

Actions

Consistent

Documented

Decisions

Prepare

Explore

Model

Implement

Act

Evaluate

Ask

Page 10: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Exploration

Data Visualization

ANALYTICAL

EXPLORATION

Traditional ReportingCreation and sharing of known

information resulting in the delivery of

reports

Data DiscoveryExploration of data to

discovery new questions and

opportunities

Advanced AnalyticsLeverage Data to make the best

decision

Forecasting

Optimization

Prediction

Standard Reports

Dashboards

Ad Hoc Query

Page 11: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

DEMO

Page 12: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

VISUAL ANALYTICS – KEY BENEFITS

Business Users

• Improves information sharing collaboration and decision making

• Broadens the use of analytics and drives more informed decisions across

the entire business

• Provides rapid insights for business people on the go, via the Web and iPad

Analysts

• Rapid exploration on vast amounts of data accelerates the model

development process by quickly identifying new areas of opportunity

• Access to all of the data, rather than subsets, provides the flexibility to

think/explore freely without dependencies on new views of data

• An equation is worth a hundred words. Picture is worth a thousand words

IT• Liberates IT to focus on more strategic initiatives by providing an easy to use, self

service data exploration model to business users

• Maintains control and governance of data while empowering business users

to have easy access to all of necessary data

• Highly scalable solution, using commodity hardware, provides easy and cost

effective growth

Page 13: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

AT SCALE MODEL GENERATION

Discovery Deployment

Iterative

Visual

Experiments

Fail Fast

Data Science

Interactive

New data

Innovation

Deep Learning

Governed

Robust

Automated

Regulated

Actions

Consistent

Documented

Decisions

Prepare

Explore

Model

Implement

Act

Evaluate

Ask

Page 14: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SCALABLE

ANALYTICS

SAS FORECAST SERVER SAS Factory Miner

• Automated Modeling / Segmentation– 1,000’s of models, model history

• APIs

• Big data

SAS Enterprise Guide

• Procedures, Data Step

• Tasks, Code generation

• Learning/Teaching

Enterprise Miner

• Full-scale data mining and machine learning, hundreds of options to customize

• Productivity (self-documenting) and operationalized / reusable analytics

Automation

Scalability

Visual Analytics / Visual Statistics

• Exploratory modeling, part of VA experience.

• Part of pattern discovery process, less about automation/conversion to production

• Fewer modeling options, data prep, transformations – mainstream algorithms

Rapid Predictive Modeler

• Easy-to-use, 3 clicks, automated approach.

• Few options to customize

• Data mining process generated behind-the-scenes.

Model

Manager

• No model building

• Model lifecycle

management

• Model profiling

• Workflow support

• Overlay with

business rules and

decision flows

• Manages R,

PMML, EM, RPM,

STAT models

Page 15: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

DEMO

Page 16: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS® FACTORY

MINER

Page 17: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

AT SCALE MODEL GOVERNANCE

Discovery Deployment

Iterative

Visual

Experiments

Fail Fast

Data Science

Interactive

New data

Innovation

Deep Learning

Governed

Robust

Automated

Regulated

Actions

Consistent

Documented

Decisions

Prepare

Explore

Model

Implement

Act

Evaluate

Ask

Page 18: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS®

MODEL

MANAGERKEY CAPABILITIES

Web-based

Workflow

Management

Compare &

Validate

Publish &

Score

Monitor &

Retrain

• Set champion /

challenger models

• Validation reports

• Audit & Tracking

• Define & schedule

scoring jobs

• Publish via SAS &

In-database routes

• Integrate business

rules*

• Performance

reports/dashboards

• Model

effectiveness

• Automated

retraining

• End-to-end

approval process

• Prebuilt/Custom

templates

• Model portfolios &

version control

*Available through SAS Decision Manager

Page 19: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

AT SCALE DEPLOYMENT

Discovery Deployment

Iterative

Visual

Experiments

Fail Fast

Data Science

Interactive

New data

Innovation

Deep Learning

Governed

Robust

Automated

Regulated

Actions

Consistent

Documented

Decisions

Prepare

Explore

Model

Implement

Act

Evaluate

Ask

Page 20: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

OPERATIONALIZING DECISION MAKING

Data Environment

Score

Output Rules

Models Rules

SCORE

CODE

db compliant

instructions

.99. 1.0, 500

Page 21: SUPPORTING ANALYTICS THAT SCALE - SAS · ANALYTICS SAS Factory MinerSAS FORECAST SERVER •Automated Modeling / Segmentation–1,000’s of models, model history •APIs •Big data

Copyr i g ht © 2015, SAS Ins t i tu t e Inc . A l l r ights reser ve d .sas.com

DISCUSSION AND QUESTION