Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I...

58
Microsoft BI Consultant Ordina Belgium Mulkens Jan Hermans Kimberly Data Scientist Ordina Belgium Democratizing Data Science With Microsoft

Transcript of Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I...

Page 1: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Microsoft BI Consultant

Ordina Belgium

Mulkens Jan Hermans Kimberly

Data Scientist

Ordina Belgium

Democratizing Data ScienceWith Microsoft

Page 2: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Who am I

Kimberly Hermans

Data Scientist & CRM consultant

Practice Manager: Data Talks

“Bringing big data, data science & visualisation together and

getting rid of the silos is what will get you the return on data”

Page 3: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Who am I

Jan Mulkens

Microsoft BI Consultant

Competence Lead: Microsoft Advanced Analytics

@JanMulkens

www.janmulkens.be

www.globalpowerbi.com

Page 4: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

ActivitiesBlog:

- www.janmulkens.be

- www.globalpowerbi.com

Speaker:

- Belgian SQL Server user group (DataMinds)

- Belgian Information Worker user group (BIWUG)

- Various other external events

- Webinars

- Guest lectures

Organiser:

- Internal Ordina events

- Virtual user group events

Page 5: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Our employer

Page 6: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

What Ordina says

“We increase our customers 'Return on Data' by taking them on a journey to a modern &

innovative data culture. We organically grow into the most focused, fast, flexible, friendly and fun BI & Data Science community on the Belgian

Market employing >100 growing & happy employees”

Page 7: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

What we experience

“We increase our customers 'Return on Data' by taking them on a journey to a modern &

innovative data culture. We organically grow into the most focused, fast, flexible, friendly and fun BI & Data Science community on the Belgian

Market employing >100 growing & happy employees”

*Emphasis is my own

Page 8: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Takeaway

Setting expectations

• Targeted at anyone looking to promote data science within their organisation. Including data scientists looking to have the business build upon their work

• Focus is on learning about which tools can help enable citizen data scientists

Tools enable citizen data science.

Microsoft made the tools for you.

What to expect Take-away

Page 9: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

End User Everyone

The age of

Classic BI

End UserIT Analyst

The age of

Self Service BIThe age of

Data Culture

Data Culture

Amir Netz & Kamal Hathi on the Age of Data Culture

https://www.youtube.com/watch?v=rg3lzHRxNqM

Page 10: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Agenda

Intro to Data Science A Fool with a ToolTooling

Page 11: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Intro to Data Science

Intro to Data Science

Page 12: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Why?

Page 13: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Value

Source: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

Why?

Page 14: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Source: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

Why?

Value

Page 15: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Source: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

Why?

Value

Page 16: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Who?

ML

Researcher

Data

ScientistML Engineer

Citizen Data Scientist

Page 17: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Up to15hrs / week

Up to15hrs / week

Up to15hrs / week

Full work week

Up to 4 hrs / week

Source: Generalized from O’Reilly’s “2015 Data Science Salary Survey” (sep 2015)

ETL Data Cleaning Machine LearningExploratory Data Analysis

Data Science Time Schedule

Page 18: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Citizen Data Scientists- Exploratory Analysis

- Visualization

- Putting insights into action

Come from both the business and IT

- BI Developers & Analysts

- Power users

Page 19: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Why?- Requirements going beyond BI

- Shortage of data scientists

- Ad-hoc analysis doesn’t scale

- Getting direct support from the business and IT for your data science project

- Bigger chance at project success & deployment because of buy-in

Page 20: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

How?Education

- Basic education on required data science topics where necessary

Page 21: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

EducationDifferent data problems require different knowledge

Clustering & dimensionality reduction: (e.g. K-means clustering)

Regression: (e.g. Linear regression)

Association: (e.g. Recommenders) Classification: (e.g. Logistic regr., trees)

Machine learning algorithms

Likely buy

BuySimilar

Page 22: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

EducationDifferent data problems require different knowledge

Predict

values

Find

unusual

occurrences

Discover

structure

Predict

categories

Page 23: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 24: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 25: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 26: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

EducationPick a data science process as a guide

Define

Goal

Collect

Data &

explore

Build

Model

Evaluate

Model

Present

Results

Deploy

Model &

monitorKDD

CRISP-DM

CCC Big Data Pipeline

Microsoft Team Data Science Process

...

Page 27: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

How?Education

- Basic education on required data science topics where necessary

Create a Data Culture

- Open communication

- Supportive learning environment

- Reviews of models & performance

- Data scientist available to help

Page 28: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

How?Education

- Basic education on required data science topics where necessary

Create a Data Culture

- Open communication

- Safe learning environment

- Reviews of models & performance

- Data scientist available to help

Tooling

- Using the right tools to help non-data scientists develop predictive solutions

Page 29: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 30: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 31: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Data Catalog- Register

- Annotate

- Understand

- Discover

Ingest Prepare Analyze Publish Consume

Page 32: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 33: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 34: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 35: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cognitive Services

Page 36: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 37: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Azure ML Studio- Easy to get started

- Create, Share & Publish

- Supports team collaboration

- Web-Basedhttps://studio.azureml.net

Page 38: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 39: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 40: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 41: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 42: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 43: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 44: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Power BI

Page 45: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 46: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 47: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Azure DS VM- Microsoft R Server

- Anaconda Python

- Julia Pro

- Jupyter Notebooks (R, Python, Julia)

- Visual Studio Community Edition- With Python, R, node.js tools

- Power BI Desktop

- SQL Server 2016 Developer Edition- Including support for in-database analytics with R Server

- Open Source Deep Learning Tools

Page 48: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

What could possibly go wrong?

Page 49: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

A Fool with a Toolss

Page 50: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Horror stories (logic)

Page 51: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Horror stories (stability)

Page 52: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Horror stories (relativity)

A B

Page 53: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Source: http://timoelliott.com/blog/wp-content/uploads/2015/03/citizen-data-scientists.png

Wrapup: Be a citizen data scientist

Page 54: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Wrapup: Use tools that enable you

Page 55: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Thank you!

Page 56: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Resources

Page 57: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

ResourcesGet inspired: Amir Netz & Kamal Hathi on “The age of data culture”

- https://www.youtube.com/watch?v=rg3lzHRxNqM

Gartner on Advanced Analytics (Oct 2014)- http://www.gartner.com/newsroom/id/2881218

Azure Data Catalog- https://azure.microsoft.com/en-us/services/data-catalog/

Cortana Intelligence Gallery- https://gallery.cortanaintelligence.com/

Page 58: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

ResourcesPower BI Partner Showcase

- https://powerbi.microsoft.com/en-us/partner-showcase/

Azure Data Science VM- https://azuremarketplace.microsoft.com/en-

us/marketplace/apps/microsoft-ads.standard-data-science-vm

Machine Learning Basics Infographic- https://docs.microsoft.com/en-us/azure/machine-learning/machine-

learning-basics-infographic-with-algorithm-examples

Microsoft Professional Program in Data Science- https://academy.microsoft.com