Building Rich Web Building Rich Web Applications Applications ...
Building crowdsourcing applications
-
Upload
simon-willison -
Category
Technology
-
view
13.453 -
download
2
description
Transcript of Building crowdsourcing applications
![Page 1: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/1.jpg)
Building crowdsourcing
applicationsSimon Willison - simonwillison.net - @simonw
@media - 9th June 2010
![Page 2: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/2.jpg)
![Page 3: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/3.jpg)
![Page 4: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/4.jpg)
Crowdsourcing?
Let me just cop to the fact that “crowdsourcing” is a stupid buzzword. But like “blog” before it, sometimes it’s the stupid term that sticks. For my purposes, it means collaborating with the people who used to be the silent audience to make something better than you could make alone. - Derek Powazek
http://powazek.com/posts/2443
![Page 5: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/5.jpg)
Crowdsourcing
Statistics
Moderation
Competition
PsychologyReal-time
Accuracy
Ethics
Game mechanics
IncentivesVisual design
CopywritingUsability
Write-heavy
Legal liability
![Page 6: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/6.jpg)
Crowdsourcing
Statistics
Moderation
Competition
PsychologyReal-time
Accuracy
Ethics
Game mechanics
IncentivesVisual design
CopywritingUsability
Write-heavy
Legal liability
![Page 7: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/7.jpg)
Crowdsourcing
Statistics
Moderation
Competition
PsychologyReal-time
Accuracy
Ethics
Game mechanics
IncentivesVisual design
CopywritingUsability
Write-heavy
Legal liability
![Page 8: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/8.jpg)
Crowdsourcing
Statistics
Moderation
Competition
PsychologyReal-time
Accuracy
Ethics
Game mechanics
IncentivesVisual design
CopywritingUsability
Write-heavy
Legal liability
![Page 9: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/9.jpg)
Crowdsourcing
Statistics
Moderation
Competition
PsychologyReal-time
Accuracy
Ethics
Game mechanics
IncentivesVisual design
CopywritingUsability
Write-heavy
Legal liability
![Page 10: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/10.jpg)
Crowdsourcing
Statistics
Moderation
Competition
PsychologyReal-time
Accuracy
Ethics
Game mechanics
IncentivesVisual design
CopywritingUsability
Write-heavy
Legal liability
![Page 11: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/11.jpg)
Examples
![Page 12: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/12.jpg)
OpenStreetMap
![Page 13: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/13.jpg)
![Page 14: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/14.jpg)
![Page 15: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/15.jpg)
![Page 16: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/16.jpg)
![Page 17: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/17.jpg)
Google Image Labeler
![Page 18: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/18.jpg)
![Page 19: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/19.jpg)
![Page 20: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/20.jpg)
ScenicOrNot
![Page 21: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/21.jpg)
![Page 22: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/22.jpg)
![Page 23: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/23.jpg)
XKCD colour survey
![Page 24: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/24.jpg)
![Page 25: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/25.jpg)
![Page 26: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/26.jpg)
![Page 27: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/27.jpg)
![Page 28: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/28.jpg)
![Page 29: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/29.jpg)
Crowdsourcing atthe Guardian
![Page 30: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/30.jpg)
The BlairRich Project
![Page 31: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/31.jpg)
![Page 32: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/32.jpg)
![Page 33: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/33.jpg)
![Page 34: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/34.jpg)
MP’s expenses v1http://mps-expenses.guardian.co.uk/
![Page 35: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/35.jpg)
Background
June 2009
450,000 pages of expenses documents released
“Transparency” = dodgy scanned PDFs
One week notice - so one week to build it!
![Page 36: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/36.jpg)
![Page 37: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/37.jpg)
![Page 38: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/38.jpg)
![Page 39: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/39.jpg)
![Page 40: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/40.jpg)
![Page 41: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/41.jpg)
![Page 42: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/42.jpg)
Stuff that worked
The progress bar
Photos of the MPs
Releasing a small group of documents at first
Score boards (once we finally added them)
Especially the “top in last 48 hours” one
![Page 43: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/43.jpg)
Stuff that didn't
Releasing everything else at once
Asking the wrong questions
Line items!
Too much time fighting scalability fires
Reporting tools were 24 hours too late
![Page 44: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/44.jpg)
Contributorsto
tal u
sers
date
![Page 45: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/45.jpg)
Votes per userus
ers
number of votes cast
![Page 46: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/46.jpg)
MP’s expenses v2http://mps-expenses2.guardian.co.uk/
![Page 47: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/47.jpg)
Background
December 2009
Smaller number of documents
One weeks notice (again)
Opportunity to learn from our earlier mistakes
![Page 48: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/48.jpg)
GoalsFind stuff our journalists cared about
Less boring data entry
Data coming out again from the start
Visible rewards for contributors
More digestible tasks
Better sense of activity by other people
![Page 49: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/49.jpg)
![Page 50: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/50.jpg)
![Page 51: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/51.jpg)
![Page 52: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/52.jpg)
![Page 53: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/53.jpg)
![Page 54: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/54.jpg)
![Page 55: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/55.jpg)
![Page 56: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/56.jpg)
Lessons learned
Use Redis for random selections, not MySQL
Assignments made a huge improvement
The most important logic in a crowdsourcing system is the next thing to review button
“Oldest first” pagination is critical
![Page 57: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/57.jpg)
WildlifeNearYou.com
![Page 58: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/58.jpg)
/dev/fort
![Page 59: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/59.jpg)
![Page 60: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/60.jpg)
Where’s mynearest llama?
![Page 61: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/61.jpg)
![Page 62: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/62.jpg)
![Page 63: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/63.jpg)
![Page 64: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/64.jpg)
![Page 65: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/65.jpg)
![Page 66: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/66.jpg)
![Page 67: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/67.jpg)
![Page 68: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/68.jpg)
![Page 69: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/69.jpg)
Lessons learned
Be flexible: your users may not share your precise goals
Optimise for the fat head of your user base
Expose recent activity to site staff
Users will do almost anything for a medal!
![Page 70: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/70.jpg)
Final thoughts
Don’t be afraid: even flawed crowdsourcing systems produce fascinating results
Think hard about the questions you ask
Have a minimal barrier to entry
Get the next task logic right. Seriously.
![Page 71: Building crowdsourcing applications](https://reader037.fdocuments.in/reader037/viewer/2022110302/545ca812b0af9f12318b49d9/html5/thumbnails/71.jpg)
Thank you
http://simonwillison.net/
http://twitter.com/simonw
http://simonwillison.net/tags/crowdsourcing/