Creating Big Data: Methodology

19
Creating Big Data: A Path for Success [email protected] http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com

Transcript of Creating Big Data: Methodology

Page 1: Creating Big Data: Methodology

Creating Big Data: A Path for Success

[email protected]://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com

Page 2: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

The VP R&D Open Seminar

HOW DO I GET DATA?

2

Page 3: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

Get Data by Barter

3

1. You can make $26B out of it2. You can connect and recommend!

Page 4: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

The Consumer Revolution

4

http://topyaps.com/wp-content/uploads/2013/03/You-are-the-product.-You-feeling-something.jpg

Page 5: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan5

@2014

Page 6: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

Get Data from Out There

6

Page 7: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

Create Partnerships

7

Page 8: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

The VP R&D Open Seminar

WHAT IS THE PROCESS

8

Page 9: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

CRISP-DM

9

By Kenneth Jensen - Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=24930610

Cross Industry Standard Process for Data Mining

Page 10: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

CRISP-DM in Details

10

http://www.slideshare.net/Tommy96/crispdm-an-introduction

Page 11: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

ETL: Extract, Transform, Load

11

https://www.dbbest.com/blog/extract-transform-load-etl-technologies-part-1/

Page 12: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

General Architecture

12

API Client

Data Store

The RiverData Retrieval Query

Indexed Data Prefix

QueryjQueryAutoComplete

Build you model

Page 13: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

The VP R&D Open Seminar

SUMMING UP THE PROCESS

13

Page 14: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

1: Create Clear Value to Your Customers

14

http://cdn.business2community.com/wp-content/uploads/2014/07/Value_Creation.jpg

Page 15: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

2: Collect Customers Insights

15

http://www.officescope.com/blog/wp-content/uploads/2013/07/Puzzle-pieces.jpg

Page 16: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

3: Fusion the Data

16

http://www.officescope.com/blog/wp-content/uploads/2013/07/Puzzle-pieces.jpg

Page 17: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

4: Create Value for Your (Real?) Customers

17

http://metro.co.uk/2010/09/28/supermarkets-big-value-packs-deemed-misleading-527232/

Page 18: Creating Big Data: Methodology

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com © Moshe Kaplan

5: Implement Using the Right Tools

18

Page 19: Creating Big Data: Methodology

Moshe Kaplan [email protected]

http://blogs.microsoft.co.il/blogs/vprndhttp://top-performance.blogspot.com