Big Data, Big Changes: Data-Driven Product Development at Etsy
-
Upload
jason-davis -
Category
Documents
-
view
1.143 -
download
4
Transcript of Big Data, Big Changes: Data-Driven Product Development at Etsy
![Page 1: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/1.jpg)
Big Data, Big Changes: Data-Driven Product Development at Etsy
Strata London, 2012
Dr. Jason DavisDirector of Search & [email protected] / @jasondavis
Monday, October 1, 12
![Page 2: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/2.jpg)
(The change)
Monday, October 1, 12
![Page 3: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/3.jpg)
6 months from inception to launch3 engineering teams3 product launchesDozens of experimentsLots and lots of data analysis
Monday, October 1, 12
![Page 4: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/4.jpg)
The switch to relevancy
Search, advertising, analytics, and more
Building big data products at Etsy
Invest in tooling
Understand tradeoffs
Appreciate complexity
Monday, October 1, 12
![Page 5: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/5.jpg)
Monday, October 1, 12
![Page 6: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/6.jpg)
By the Numbers
1.4B pageviews/month
$525MM sales in 2011
40MM unique visitors/month
800k shops / 150 countries
Monday, October 1, 12
![Page 7: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/7.jpg)
SELECT * FROM listings WHERE title LIKE '%silver%' ORDER BY creation_tszDESC;
Monday, October 1, 12
![Page 8: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/8.jpg)
Solving the recency problem
Monday, October 1, 12
![Page 9: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/9.jpg)
Better buyer experience
Improved search relevancy
Monday, October 1, 12
![Page 10: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/10.jpg)
Improved advertising
Search Ads
Monday, October 1, 12
![Page 11: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/11.jpg)
More search insight for sellers
Shop Stats
Monday, October 1, 12
![Page 12: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/12.jpg)
Building big data products
Monday, October 1, 12
![Page 13: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/13.jpg)
Build lots of tools
Monday, October 1, 12
![Page 14: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/14.jpg)
Go to the sourceRaw data
visit logsraw query logs
Descriptive statistics
search depthquery conversion rates
Monday, October 1, 12
![Page 15: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/15.jpg)
Invest in tooling
Lunr
Monday, October 1, 12
![Page 16: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/16.jpg)
Side by side testing
Monday, October 1, 12
![Page 17: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/17.jpg)
A/B Analyzer
Monday, October 1, 12
![Page 18: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/18.jpg)
Shop Stats with Referrals
Monday, October 1, 12
![Page 19: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/19.jpg)
Understand tradeoffs
(most tradeoffs don’t look like this)
Monday, October 1, 12
![Page 20: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/20.jpg)
The bike is 20% lighter!Monday, October 1, 12
![Page 21: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/21.jpg)
Queries a, b, & c are better. Queries x & y are not.
Monday, October 1, 12
![Page 22: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/22.jpg)
¡Hola! வணக்கம்!
Guten Tag 你好 ألّس'م عليكم
Hello नम#$ 今日は
Monday, October 1, 12
![Page 23: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/23.jpg)
How will the change affect behavior?
Affect expectations?
User incentives?
Improved data?
Thinking short-term vs long-term
Monday, October 1, 12
![Page 24: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/24.jpg)
Appreciate complexity
Monday, October 1, 12
![Page 25: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/25.jpg)
Vs
Algorithmic Complexity
Monday, October 1, 12
![Page 26: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/26.jpg)
4 months30 experiments11 wins
Success / Complexity Tradeoff
Monday, October 1, 12
![Page 27: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/27.jpg)
June 2005
November 2006
May 2008
Today
UI Complexity
Monday, October 1, 12
![Page 28: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/28.jpg)
Communications & Support Complexity
Monday, October 1, 12
![Page 29: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/29.jpg)
(The change)
Monday, October 1, 12
![Page 30: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/30.jpg)
Etsy - Strata NYCContinous Experimentation with Continuous DeplyomentSteve Mardenfeld
Scala + Cascading = ScaldingAvi Bryant
Case Study: What’s a Customer Worth?Roberto Medri
October 23-25
Monday, October 1, 12
![Page 31: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/31.jpg)
ResourcesCode as Craft bloghttp://codeascraft.etsy.com/
Slides (including these)http://www.slideshare.net/etsy
Github http://github.com/etsy/
Join in the fun http://www.etsy.com/careers/
Monday, October 1, 12
![Page 32: Big Data, Big Changes: Data-Driven Product Development at Etsy](https://reader034.fdocuments.in/reader034/viewer/2022042507/5555db53d8b42aaf158b51d9/html5/thumbnails/32.jpg)
Monday, October 1, 12