Why We Need More Data by Lukas Biewald

46
Why We Need More Data

Transcript of Why We Need More Data by Lukas Biewald

Page 1: Why We Need More Data by Lukas Biewald

Why We Need More Data

Page 2: Why We Need More Data by Lukas Biewald

Lots of Data

Page 3: Why We Need More Data by Lukas Biewald

The Effect of Better Algorithms

Naïve Bayes Maximum Entropy SVM0%

5%

10%

15%

20%

25%

Classifier Error Rate

Active Semi-Supervised Learning for Improving Word Alignment

(Vamshi ACL ’10)

Real World Data

Page 4: Why We Need More Data by Lukas Biewald

The Effect of Better Features

Unigrams Bigrams Unigrams+Bigrams0%

5%

10%

15%

20%

25%

30%

Classifier Error Rate

Page 5: Why We Need More Data by Lukas Biewald

Real World Data

Page 6: Why We Need More Data by Lukas Biewald

The Effect of More Data

90%

Acc

urat

e Dat

a

95%

Acc

urat

e Dat

a

100%

Acc

urat

e Dat

a0%

2%

4%

6%

8%

10%

12%

14%

Classifier Error Rate

Active Semi-Supervised Learning for Improving Word Alignment

(Vamshi ACL ’10)

Real World Data

Page 7: Why We Need More Data by Lukas Biewald

The Effect of Cleaner Data

N 2N 4N0%

2%

4%

6%

8%

10%

12%

14%

Classifier Error Rate

Page 8: Why We Need More Data by Lukas Biewald

Where Do Data Scientists Spend Their Time?

Source: CrowdFlower Data Science Report 2015

Page 9: Why We Need More Data by Lukas Biewald

The Power of Open Data

Page 10: Why We Need More Data by Lukas Biewald

CrowdFlower Data Enrichment Platform

Page 11: Why We Need More Data by Lukas Biewald

Color Data

Page 12: Why We Need More Data by Lukas Biewald
Page 13: Why We Need More Data by Lukas Biewald
Page 14: Why We Need More Data by Lukas Biewald
Page 15: Why We Need More Data by Lukas Biewald
Page 16: Why We Need More Data by Lukas Biewald
Page 17: Why We Need More Data by Lukas Biewald
Page 18: Why We Need More Data by Lukas Biewald

Fleshmap

Page 19: Why We Need More Data by Lukas Biewald

19

Page 20: Why We Need More Data by Lukas Biewald

Drug Side Effects

Page 21: Why We Need More Data by Lukas Biewald
Page 22: Why We Need More Data by Lukas Biewald
Page 23: Why We Need More Data by Lukas Biewald

Apple Watch

Page 24: Why We Need More Data by Lukas Biewald

Apple Watch

Page 25: Why We Need More Data by Lukas Biewald

Apple Watch

Page 26: Why We Need More Data by Lukas Biewald

Apple Watch

Page 27: Why We Need More Data by Lukas Biewald

Data For Everyone

Page 28: Why We Need More Data by Lukas Biewald

Collecting the Same Data Over and Over

28

Page 29: Why We Need More Data by Lukas Biewald

Open Data

Page 30: Why We Need More Data by Lukas Biewald

Make Your Data Public Setting

Page 31: Why We Need More Data by Lukas Biewald

Data for Everyone

Page 32: Why We Need More Data by Lukas Biewald

Data For Everyone Library

Page 33: Why We Need More Data by Lukas Biewald

Data for Everyone

33

Page 34: Why We Need More Data by Lukas Biewald

Data For Everyone

34

Page 35: Why We Need More Data by Lukas Biewald

Categorize URLs

Page 36: Why We Need More Data by Lukas Biewald

URL Categorization

Page 37: Why We Need More Data by Lukas Biewald

Open Data API

Page 38: Why We Need More Data by Lukas Biewald

Record Data

Page 39: Why We Need More Data by Lukas Biewald

Extracting Names and Titles

Page 40: Why We Need More Data by Lukas Biewald

Summarization

Page 41: Why We Need More Data by Lukas Biewald

Is an Image Funny?

Page 42: Why We Need More Data by Lukas Biewald

Classifying Medical Images

Page 43: Why We Need More Data by Lukas Biewald

Attributes of People

Page 44: Why We Need More Data by Lukas Biewald
Page 45: Why We Need More Data by Lukas Biewald

396 Scripts

Page 46: Why We Need More Data by Lukas Biewald

TWITTER.COM/[email protected]

Thank YouLukas Biewald

[email protected]@L2K