Advanced growth techniques from Pinterest’s growth expert - John Egan

40
Data Driven Growth 1 John Egan Engineering Manager - Engagement Team @ Pinterest

Transcript of Advanced growth techniques from Pinterest’s growth expert - John Egan

Page 1: Advanced growth techniques from Pinterest’s growth expert - John Egan

Data Driven Growth

1

John Egan Engineering Manager - Engagement Team @ Pinterest

Page 2: Advanced growth techniques from Pinterest’s growth expert - John Egan

2

• Retail shopping rewards app • Led Growth Engineering team • Grew from 1MM to 8MM users in 3 years

• Acquired for $200MM

• Visual discovery & bookmarking app

• Eng manager for Engagement • Over 100 million MAUs • Engagement experiments have added millions of WAUs

Page 3: Advanced growth techniques from Pinterest’s growth expert - John Egan

Pre Product/Market Fit

Page 4: Advanced growth techniques from Pinterest’s growth expert - John Egan

Focus on Product First

4

Page 5: Advanced growth techniques from Pinterest’s growth expert - John Egan

Initial Traction

Page 6: Advanced growth techniques from Pinterest’s growth expert - John Egan

Do Things That Dont Scale

6

Page 7: Advanced growth techniques from Pinterest’s growth expert - John Egan

Growth Stage

Page 8: Advanced growth techniques from Pinterest’s growth expert - John Egan

Prioritize Based On ROI

8

Page 9: Advanced growth techniques from Pinterest’s growth expert - John Egan

9

New Users

MAUs

Dormant Users

Page 10: Advanced growth techniques from Pinterest’s growth expert - John Egan

10

New Users

MAUs

Dormant Users

Page 11: Advanced growth techniques from Pinterest’s growth expert - John Egan

11

New Users

MAUs

Dormant Users

Page 12: Advanced growth techniques from Pinterest’s growth expert - John Egan

12

New Users

Dormant Users

Core

Casual

Marginal

Page 13: Advanced growth techniques from Pinterest’s growth expert - John Egan

13

New Users

MAUs

Dormant Users

Page 14: Advanced growth techniques from Pinterest’s growth expert - John Egan

MAU Growth Accounting

14

Page 15: Advanced growth techniques from Pinterest’s growth expert - John Egan

Acquisition

15

Page 16: Advanced growth techniques from Pinterest’s growth expert - John Egan

Funnels

16

Page 17: Advanced growth techniques from Pinterest’s growth expert - John Egan

17

2013

Page 18: Advanced growth techniques from Pinterest’s growth expert - John Egan

18

2014

Page 19: Advanced growth techniques from Pinterest’s growth expert - John Egan

19

2015

Page 20: Advanced growth techniques from Pinterest’s growth expert - John Egan

Activation

20

Page 21: Advanced growth techniques from Pinterest’s growth expert - John Egan

1d7s• Percentage of new signups that use the app 1 or more times in the week

following signup • Quicker to run experiments with • At Pinterest this is highly correlated with user’s long-term retention

21

Page 22: Advanced growth techniques from Pinterest’s growth expert - John Egan

22

Page 23: Advanced growth techniques from Pinterest’s growth expert - John Egan

23

Page 24: Advanced growth techniques from Pinterest’s growth expert - John Egan

Engagement

24

Page 25: Advanced growth techniques from Pinterest’s growth expert - John Egan

One Key Engagement MetricMedium: Total Time Spent Reading (TTR) Twitter: MAUs with 7+ visits a month (7d28s) Uber: Weekly Trips Facebook: WAUs with 6+ visits a week (6L7s) Pinterest: Weekly Active Repiners or Clickers (WARCs)

25

Page 26: Advanced growth techniques from Pinterest’s growth expert - John Egan

Finding Your Key Engagement Metric1) What are the actions a user has to take to get value from your product?

2) What is the frequency someone need to use your product

26

Page 27: Advanced growth techniques from Pinterest’s growth expert - John Egan

User States

Core: Active multiple times a week Casual: Active once or twice a week Marginal: Active a couple times a month New: Joined in the past 28 days Dormant: Not active for 28 days Resurrected: Was dormant, but became active again in the past 28 days

27

Page 28: Advanced growth techniques from Pinterest’s growth expert - John Egan

Badging Holdout Experiment

2:50 PM 100%

28

Page 29: Advanced growth techniques from Pinterest’s growth expert - John Egan

Measuring Effect on Engagement

29

Page 30: Advanced growth techniques from Pinterest’s growth expert - John Egan

Retention & Resurrection

30

Page 31: Advanced growth techniques from Pinterest’s growth expert - John Egan

Marketing

Pros: • Coverage. Can reach the entire user base

Cons: • Not personalized, lower open rates • User’s have much lower tolerance

compared to emails

31

Page 32: Advanced growth techniques from Pinterest’s growth expert - John Egan

Transactional

Pros: • More personal than marketing

notifications

Cons: • Users need activity to generate

notifications • Need mechanisms to rate limit

32

Page 33: Advanced growth techniques from Pinterest’s growth expert - John Egan

Recommendations

Pros: • Coverage. Can reach most users • Personalized to the user

Cons: • Expensive and time consuming to build

out recommendation engine • Quality may not be good if user has low

amount of activity

33

2:50 PM 100%2:50 PM 100%

Page 34: Advanced growth techniques from Pinterest’s growth expert - John Egan

Measuring Engagement for Emails/Push

• Positive measures of quality - Must lift key engagement metric - Minimum required CTR rates

• Negative measures of quality - App deletions - Spam reports - Unsubscribes

34

Page 35: Advanced growth techniques from Pinterest’s growth expert - John Egan

Experiment Segmentation

35

Page 36: Advanced growth techniques from Pinterest’s growth expert - John Egan

All Users

36

Page 37: Advanced growth techniques from Pinterest’s growth expert - John Egan

Marginal Users (~1 month)

37

Page 38: Advanced growth techniques from Pinterest’s growth expert - John Egan

Core Users (multiple times a week)

38

Page 39: Advanced growth techniques from Pinterest’s growth expert - John Egan

Wrap Up• Pre Product/Market Fit: Product comes first

• Initial Traction: Do things that don’t scale

• Growth Stage: Prioritize projects based on return on investment

• Use funnels for analyzing acquisition flows

• 1d7s to analyze on activation

• Use user states to understand how engaged users are

• Make sure emails/notifications for true engagement

• Use segmentation for experiments & metrics in general

39

Page 40: Advanced growth techniques from Pinterest’s growth expert - John Egan

John EganGrowth Blog: jwegan.com

Email: [email protected]

Twitter: @jwegan_com

Pinterest: pinterest.com/jwegan

40