Data Science for Everyone - KNIME...•Customer Data •Task is Upselling prediction •Product is a...

Data Science for Everyone

Greg Landrum

Rosaria Silipo

Introduction to the characters

• The scientist (chemist, business analyst, domain expert, etc.).

– Deep domain knowledge

– Strong analytics needs (questions that need to be answered!)

• The data scientists (analyst, modeler, informatician, data scientist, etc.)

– Deep knowledge of analytics, data processing

– Knows KNIME (and other tools)

The specific scenario/problem

The scientist:

“I’m trying to discover a new anti-malaria medicine. I’ve got a new dataset from a high-throughput screen against a malaria target. Doing the next experiments is expensive. I want to pick the right compounds from our inventory to try next.”

The scenario/problem

• Given a new dataset, clean it up so that a model can be built

• Build and validate a model from that dataset

• Use the model to prioritize a set of items from a catalog

• Let the user pick from that prioritized list

The steps for doing this

• Cleaning up the data

• Building and validating a model

• Ranking a set of new items from a catalog

• Letting the user pick the items they are interested in

• Providing an excel file

This is a familiar pattern, we know how to do this

A guided analytics solution

• The data scientist builds a data preparation and modeling workflow in KNIME capturing their most robust approach along with a solid validation protocol that won’t let a low-quality model pass.

• The data scientist deploys this model as a web application using the KNIME server.

• The scientist can then upload their data, build and validate a model, and then apply it to generate predictions for the items in their catalog in order to decide which experiments to do next.

Data Cleaning

The 80% problem

http://www.nytimes.com/2014/08/18/technology/for-big-data-scientists-hurdle-to-insights-is-janitor-work.html

Data scientists, according to interviews and expert estimates, spend from 50 percent to 80 percent of their time mired in this more mundane labor of collecting and preparing unruly digital data, before it can be explored for useful nuggets.

Data Cleaning & Data Scientists

https://twitter.com/mrogati/status/601538814746628096

7 Techniques for Dimensionality Reduction

Column Reduction based on:

1. Missing values 2. High correlation3. Low standard deviation4. PCA5. Infrequent choice in random forest shallow trees6. Backward Feature Elimination7. Forward Feature Construction

Whitepaper on KNIME web site https://www.knime.org/files/knime_seventechniquesdatadimreduction.pdf

Dataset Quality Measures

Additional Techniques for Data Dimensionality Reduction:

• Low Skewness

• Outlier Removal

Measure Dataset Quality Before and After:

• Average Error (%) from Cross-Validation

• Normalized Cronbach Alpha

Data Cleaning as a Process

• Reliable (cross-domain)

• Repeatable (not automatic)

• Interactive (human expert supervised)

• From a Web Browser (no KNIME expertise)

• On demand

CRM Dataset

• Customer Data

• Task is Upselling prediction

• Product is a lawyer insurance

• Lawyer Insurance 0/1 is Target

• If lawyer insurance was bought then after a little while lawyer was assigned

• 10K data rows x 33 data columns

From KNIME WebPortal: Login

From KNIME WebPortal: Start

From KNIME WebPortal: Upload File

Only .table and .csv files

From KNIME WebPortal: Initial Dataset Quality

From KNIME WebPortal: Missing Values

From KNIME WebPortal: Outliers

From KNIME WebPortal: Low Standard Deviation

From KNIME WebPortal: Low Skewness & High Correlation

From KNIME WebPortal: Final Dataset Quality

From KNIME WebPortal: Back to Refine

From KNIME WebPortal: Final dataset Quality again

From KNIME WebPortal: Workflow successful

Workflow

Metanode “Dataset Quality”

Malaria Dataset

• Patient Data

• Task is Pf3D7_ps_hit = yes/no

• Primary & secondary readouts, SMILES, experiment date, sample

• Many primary readout ?

• 6675 data rows x 8 data columns

From KNIME WebPortal: Initial Dataset Quality

From KNIME WebPortal: Missing Values

From KNIME WebPortal: Outliers

From KNIME WebPortal: Low Standard Deviation

From KNIME WebPortal: Low Skewness & High Correlation

From KNIME WebPortal: Final Dataset Quality

That was easy!

Happy scientist!

Model building

The modeling and prediction workflow

Reading the cleaned data and adding the chemistry-specific details

Building a model

Evaluating the model

Ranking and picking new items

Robust learning: use multiple models and representations

• Multiple models:

– Random forest (representation 2)

– Gradient boosting (representation 1)

– Fingerprint Bayes (representation 1)

– Logistic regression (representation 1)

– Logistic regression (representation 2)

• Combine predictions using "model fusion"

Validation

• The model will be used for ranking new items

• To ensure that it is useful we will evaluate it based both on overall accuracy (using Cohen’s Kappa) and how accurate early picks are (using enrichment)

Validation

• Parameters from the Scorer node, adapted to model fusion

• Accuracy parameters from the ROC node

When the model isn’t good enough

Accuracy thresholds are set by the data scientist when building the workflow

The workflow ends here.No sense continuing with a model that's unreliable/misleading.

Making predictions

Read items from catalog

Generate predictions

Show histogram and ask for number of items to consider

Interactive selection

Download Excel file

Interactive selection

Create images for the table

Create plots Keep only rows that are selected in the table

The output, Excel at last!

That’s it!

• Whitepapers & workflows for the two different parts coming soon!

• For more infos email: education@knime.com

The KNIME® trademark and logo and OPEN FOR INNOVATION® trademark are used by KNIME.com AG under license from KNIME GmbH, and are registered in the United States.

KNIME® is also registered in Germany.

Data Science for Everyone - KNIME...•Customer Data •Task is Upselling prediction •Product is a...

Documents

Transcript of Data Science for Everyone - KNIME...•Customer Data •Task is Upselling prediction •Product is a...

Key Senator Scrutinizes Pharmacy 340B Selling Practicesthe practice “upselling.” There is nothing illegal about this. In an interview, a Grassley staffer acknowledges that upselling

Upselling in a medical market, tips & tricks on how to ...Upselling in a medical market, tips & tricks on how to increase sales

Upselling UX: Moving from Pixels to Strategy

The SHOCKING Truth About Lawyer Advertisingplg-pllc.com/wp-content/uploads/2011/03/Straight-Talk-Lawyer... · • All lawyers carry legal malpractice insurance. • If a lawyer advertises

5KEY TECHNIQUESdoclibrary.com/MFR1644/DOC/RestaurantCheckAveragesFINAL5103.pdfknow when upselling is appropriate and which upselling techniques will work best for their patrons. Heavy

Ethical Issues in Insurance: 2015 Update March 18, 2015; 6 ... Issues in Insurance Law -- 2015 Up… · Model Rule 5.4(c) provides a lawyer "shall not permit a person who pays a lawyer

Incrementa - Increase your Upselling Revenue

How to Find Best Car Insurance Lawyer

1001 system 2 aaccount m driving upselling, excitemen

Upselling Workshop

Insurance Lawyer in Singapore

2020 Member Benefits Booklet€¦ · Classifieds Meeting & Conference Space Lawyer Referral Service. Design & Marketing Legal Research Insurance Travel. Retail Wellness Alabama Lawyer

Fnb Training Service & Upselling

When Not to Accept the Insurance Company’s Chosen Lawyer

UPSELLING BREAKFAST AND GUEST COMMUNICATIONS

Upselling Creding Cards Throug EMI

The Travel Guide to Upselling and Cross-Selling

Successful Upselling for Hotels

What We Have Learned From Menchaca€¦ · Texas Lawyer “Go To” Lawyer in Insurance Law 2012; Texas Lawyers “Top Notch Lawyer” (one of five nominees for the “Go To” Lawyer

Upselling techniques