Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466...
Transcript of Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466...
![Page 1: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/1.jpg)
Anthony Goldbloom Kaggle [email protected] @antgoldbloom
Heritage Health Prize
Photo by mikebaird, www.flickr.com/photos/mikebaird
A predictive modeling competition that’s life & death
![Page 2: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/2.jpg)
Agenda –
What is Kaggle What are data science competitions The Heritage Health Prize Lessons Learned
![Page 3: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/3.jpg)
Kaggle Connect is a marketplace with the world’s best, ranked
![Page 4: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/4.jpg)
Kaggle Connect: submit your project and get matched with a data scientist
![Page 5: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/5.jpg)
Agenda –
What is Kaggle What are data science competitions The Heritage Health Prize Lessons Learned
![Page 6: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/6.jpg)
![Page 7: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/7.jpg)
Competitions are judged on objective criteria
Competition Mechanics
![Page 8: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/8.jpg)
![Page 9: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/9.jpg)
Agenda –
What is Kaggle What are data science competitions The Heritage Health Prize Lessons Learned
![Page 10: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/10.jpg)
The world’s largest ever data science competition
![Page 11: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/11.jpg)
Competition Mechanics
![Page 12: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/12.jpg)
Competition Mechanics
![Page 13: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/13.jpg)
The prize launched on April 4th 2011 to lots of attention
![Page 14: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/14.jpg)
First milestone prize was awarded on October 4th 2011
![Page 15: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/15.jpg)
Winners include an IBM consultant and a hedge fund trader
0
50
100
150
200
250
0.46
0.462
0.464
0.466
0.468
0.47
0.472
0.474
May-11 August-11 November-11 February-12 May-12 August-12 November-12 February-13
Submission Count
Leading Score
![Page 16: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/16.jpg)
Meet Phil, the IBMer who was part of the team that won the first milestone prize
![Page 17: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/17.jpg)
Second milestone prize was announced on April 4th 2012
![Page 18: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/18.jpg)
Dave & Phil win milestone prize 2 as well
0
50
100
150
200
250
0.46
0.462
0.464
0.466
0.468
0.47
0.472
0.474
May-11 August-11 November-11 February-12 May-12 August-12 November-12 February-13
Submission Count
Leading Score
![Page 19: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/19.jpg)
Third milestone prize was announced on October 4th 2012
![Page 20: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/20.jpg)
Third awarded to a BI consultant and a software engineer
0
50
100
150
200
250
0.46
0.462
0.464
0.466
0.468
0.47
0.472
0.474
May-11 August-11 November-11 February-12 May-12 August-12 November-12 February-13
Submission Count
Leading Score
![Page 21: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/21.jpg)
The competition closed on April 4th 2013
![Page 22: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/22.jpg)
Final prize will be announced at the in DC on June 4th
0
50
100
150
200
250
0.46
0.462
0.464
0.466
0.468
0.47
0.472
0.474
May-11 August-11 November-11 February-12 May-12 August-12 November-12 February-13
Submission Count
Leading Score
~2,000 participants in 1,660 teams 35,771 entries Over 4 years worth of man hours spent on the competition
![Page 23: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/23.jpg)
Agenda –
What is Kaggle What are data science competitions The Heritage Health Prize Lessons Learned
![Page 24: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/24.jpg)
Top entries bunch at around the same level of predictive accuracy
![Page 25: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/25.jpg)
There’s only so much information you can extract from a data set
0
50
100
150
200
250
0.46
0.462
0.464
0.466
0.468
0.47
0.472
0.474
May-11 August-11 November-11 February-12 May-12 August-12 November-12 February-13
Submission Count
Leading Score
![Page 26: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/26.jpg)
![Page 27: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/27.jpg)
“In less than a week, Martin O’Leary, a PhD student in glaciology, outperformed the state-of-the-art algorithms”
“The world’s brightest physicists have been working for decades on solving one of the great unifying problems of our universe”
Kaggle’s Dark Matter Competition on the White House blog
![Page 28: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/28.jpg)
![Page 29: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/29.jpg)
Phil Brierley has performed well in a huge range of problems
![Page 30: Heritage Health Prize - Predictive Analytics · PDF file100 150 200 250 0.46 0.462 0.464 0.466 0.468 0.47 ... Meet Phil, the IBMer who was ... The Heritage Health Prize Lessons Learned](https://reader033.fdocuments.in/reader033/viewer/2022051723/5ab1b9dc7f8b9a284c8ce6b1/html5/thumbnails/30.jpg)
Kaggle Connect provides the people – many of the world’s best, ranked