A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into...

41
Preparing your business for data science A checklist for success @stefflocke @lockedata

Transcript of A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into...

Page 1: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Preparing your business for data

scienceA checklist for success

@stefflocke@lockedata

Page 2: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Preparedness is about people, processes, and

tools!

Page 3: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Agenda

Page 4: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Steph LockeLocke Data

Data Science & DataOps focus

Microsoft MVP

Author

@stefflocke

@lockedata

Page 5: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Abstract• Data platform maturity

• Use of data products within the business

• Skillsets of existing business intelligence and other analytical teams

• Analytical teams processes and capabilities

• IT and analytical teams alignment to business goals

• Recruitment, induction, and professional development processes

• Legal, ethical, and regulatory considerations

Starting out on a project without adequate planning, risks wasted time and money when you hit unexpected roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal obligations, can expose you to substantial problems.

Armed with the checklist, there'll be fewer "unknown unknowns" that could derail your project or cause extra cost. Let's get planning!

Page 6: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Data scienceWhat is data science and what’s involved at a high level?

Page 7: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

What isdata science?

Predictions

ForecastsRecommendations

Finding oddities

Assistance

Page 8: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Data science is solving problems by building models of how things work from data

90% of people who bought paddling pools went on to buy sandals, swimsuits, or suntan

lotion

Hey, you bought a pool! Do you need these items too?

Page 9: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

The problems data science should solve are business problems

Increase market share Improve marketing?Increase profits Improve upselling?Decrease overheads Reduce waste?

Page 10: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Data scientists aim to change behaviours in order to achieve the business goal

Page 11: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Goal

Business understanding

Data understanding

ModelingEvaluate

Deploy

Monitor

CRISP-DM

Page 12: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Examples

Page 13: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Loan pricing

Application

Credit score

House valuation Our view of risk

Competitors views of risk

Price

Page 14: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Risky behaviour onlineProductivity app traffic dropped off

Big spike in traffic to malware by Jim

Bob’s web traffic doesn’t look like everyone else’s in the dev team.

Page 15: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

BASEL II

Portfolio

Risk

StressRisk

Page 16: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Skype’s Babel Fish

Page 17: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

IoC

Page 18: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

PeopleWhat are the people factors you need to evaluate?

Page 19: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Areas

• Skillsets of existing business intelligence and other analytical teams•Recruitment, induction,

and professional development processes• Legal, ethical, and

regulatory considerations

Page 20: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

ProcessesWhat are the process factors you need to evaluate?

Page 21: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Areas

•Analytical teams processes and capabilities• IT and analytical teams alignment to business goals•Legal, ethical, and regulatory considerations

Page 22: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

ToolsWhat tools do you need to succeed?

Page 23: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Areas

•Data platform maturity

•Use of data products within the business

Page 24: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Data scientists

Page 25: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

A data scientist is a team

Page 26: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Wrangling skills

Page 27: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Modeling skills

Page 28: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Communication skills

You’ll see this sinusoidal

curve doesn’t fit well

HELP ME!!!

Page 29: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Coding skills

C#

PythonSQL

Scala

Page 30: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Advice

Page 31: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Start big but not too big

Importance

Imp

ac

tGreat

Great

Bad

Bad Bad

Bad

OK

OK

OK

Page 32: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

The C-suite needs to understand the process

Page 33: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Do projects in a range of silosSales

Customer Services

Finance

Logistics

Ops

Marketing

Page 34: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Get something good in production before worrying about great

75% accuracyTime taken: 1

week

78% accuracyTime taken: 6

weeks

Page 35: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

You can’t have good data science with bad data

Hey, you turned on the lights. Should I start the

lawnmower?

Page 36: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

You don’t can’t have fast data science without DataOps

Page 37: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

DataOps = Agility

People

Process

Tools

Coping withchange

Quickto build

Satisfaction / fitnessmetrics

Continuous integration

Code review

Continuouslearning

Teachsimplicity

Face to face /virtual

Productivitytools

Coherentcommunication

Quantifiedvalue

Planning

Continuousimprovement

Automation

Page 38: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Research time required

What if…

Page 39: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Readiness

•People

•Processes

•Tools

Page 40: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Sign up at bit.ly/lockesubscribeand I’ll send you the

checklist

Page 41: A checklist for success - Microsoft...roadblocks. Additionally, putting a data science project into production without sufficient testing, monitoring, and due diligence around legal

Thank you!Thank you to the organisers, sponsors, and volunteers too!

Psst … follow me on twitter @stefflocke

@lockedata and don’t forget to grab stickers and business cards on

your way out!