The story of the Product Growth team at Atlassian
-
Upload
ilias-flaounas -
Category
Data & Analytics
-
view
644 -
download
1
Transcript of The story of the Product Growth team at Atlassian
![Page 1: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/1.jpg)
The story of the Product Growth team at Atlassian
Ilias Flaounas Sr. Data Scientist
!!!!
Web Analytics Meetup, Sydney 14 October 2015
![Page 2: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/2.jpg)
Atlassian - Trivia• Atlassian is an Australian enterprise software
company specialised in products that support project management and collaboration.
• ~13 years old
• >1.5K employees
• Headquarters in Sydney
• Best place to work in Australia (2014 & 2015)(The Australian Financial Review)
![Page 3: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/3.jpg)
![Page 4: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/4.jpg)
![Page 5: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/5.jpg)
![Page 6: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/6.jpg)
Key Requirements:!
• Support from upper management!
• Some minimum critical mass of customers!
• Serious investmentin infrastructure, people,time
![Page 7: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/7.jpg)
Product Growth Team• 18 members (from initially 6 members
on 2013)
• Main mission: Increase Active Users!
• How? * Discover value in behavioural data * Experiment* Suggest improvements!
• Champion data-driven decision making
![Page 8: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/8.jpg)
Reed Johnson
Ilias Flaounas
Stephen Lee
Shaun Clowes
Graeme Smith
Tim Garnsey
Fardin Sarker
Theo Voronov
Herman Chow
Leo Balan
Rob Sangster
Andrew Wakeling
Martin Smyrk
Houda Chehab
Lakshan Perera
Isabelle Flores
Antony Russel
Benjamin Humphrey
![Page 9: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/9.jpg)
![Page 10: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/10.jpg)
![Page 11: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/11.jpg)
![Page 12: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/12.jpg)
![Page 13: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/13.jpg)
![Page 14: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/14.jpg)
Where do we fit in the org? A kind of stretched analogy…
Patient User
Illness Bad User Experience
Medical doctor Product manager
Diagnosis Interviews, surveys…
Treatment UX modification
Medical researchers Growth teamObservations Data mining
Medical trials A/B tests
Ethics Privacy PolicyEvidence-based
medicineData-driven
development
![Page 15: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/15.jpg)
The Challenges• Build infrastructure!
- break data silos - replace existing “solutions” - improve data quality - add instrumentation
![Page 16: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/16.jpg)
We analyse the behavioural dataTimestamp Instance User Event Attributes
1356958862 abcd2134abcd AB12FF89 Login1356968863 abcd2134abcd DA99A11 Login1356978862 abcd2134abcd AB12FF89 dashboard view1356988862 abcd2134abcd DA99A11 dashboard view1357884442 abcd2134abcd FF12FF89 view issue {issueID = 1234}1357956862 abcd2134abcd AB12FF89 create issue {issueID = 1000}1357957862 abcd2134abcd DA99A11 view issue {issueID = 1000}1357958862 abcd2134abcd DA99A11 comment issue {issueID = 1000}1357959862 abcd2134abcd AB12FF89 create issue {issueID = 1001}
… … … … …
![Page 17: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/17.jpg)
Analytics Infrastructure (v.2)On 2014:!
~3-4TB overall (highly compressed)!
800GB per day produced (uncompressed)
![Page 18: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/18.jpg)
![Page 19: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/19.jpg)
![Page 20: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/20.jpg)
![Page 21: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/21.jpg)
• Build infrastructure!- break data silos - replace existing “solutions” - add instrumentation - improve data quality
• Cultural change & Education!- help people ask the correct
questions!- challenge gut feelings!- “analytics is counting”
The Challenges
![Page 22: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/22.jpg)
Help people ask the correct questions…
![Page 23: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/23.jpg)
Help people ask the correct questions…
Report 1 Report 2 Report 3 Report 4 Report 5 Report 6 Report 7 Report 8 Report 9
![Page 24: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/24.jpg)
![Page 25: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/25.jpg)
No usage
![Page 26: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/26.jpg)
No usage Low usage
![Page 27: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/27.jpg)
No usage Low usage Medium usage High usage
![Page 28: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/28.jpg)
Deal with gut feelings & common sense…
How Common Sense Fails Duncan Watts, 2011
κοινὴ αἲσθησις Aristotle, 384–322 BCE
![Page 29: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/29.jpg)
Correlation & Causality
![Page 30: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/30.jpg)
• Source: P. Chopra, The ultimate guide to A/B testing, http://www.smashingmagazine.com, 2010
![Page 31: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/31.jpg)
Voting time: Raise your Left or Right hand for the version that worked best; No hand if you believe there’s no difference
![Page 32: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/32.jpg)
Subject: %%first_name%%, assemble the
bitbucketeers!
Subject: Grab the Bitbucketeers...4, 3, 2, 1
LAUNCH!
Voting time: Raise your Left or Right hand for the version that worked best; No hand if you believe there’s no difference
![Page 33: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/33.jpg)
Voting time: Raise your Right hand for success; Left hand for failure; No hand if you believe there’s no difference
![Page 34: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/34.jpg)
Voting time: Raise your Right for success; Left hand for failure; No hand if you believe there’s no difference
![Page 35: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/35.jpg)
Voting time: Raise your Right hand for success; Left hand for failure; No hand if you believe there’s no difference
![Page 36: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/36.jpg)
Deal with “Analytics is counting”…
![Page 37: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/37.jpg)
X. Fu & H. Asorey, “Data driven product Innovation”, Tutorials, KDD 2015
We are completing a transition…
• Phase A: Data scientists as Owners • Phase B: Data scientists as a Service • Phase C: Data scientists as Partners
![Page 38: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/38.jpg)
Take away message
• Becoming data-driven is hard
• Cultural change is the key challenge - More difficult than the engineering part
• The transition is a marathon not a sprint
• There’s no common sense, thus potential is high
![Page 39: The story of the Product Growth team at Atlassian](https://reader031.fdocuments.in/reader031/viewer/2022030300/58808a091a28ab35718b6725/html5/thumbnails/39.jpg)
Thank you!