How to Optimize Your Product and Business Using Analytics · 2020-05-14 · How to Optimize Your...
37
How to Optimize Your Product and Business Using Analytics Dan Olsen August 2017
Transcript of How to Optimize Your Product and Business Using Analytics · 2020-05-14 · How to Optimize Your...
How to Optimize Your Product and Business Using Analytics Dan Olsen August 2017
MyBackgroundEduca/onn Engineeringbackgroundn StanfordMBAn UXdesignandcodingExperiencen Managednuclearsubmarinedesignn ProductManagementleaderatIntuitn CEO&Cofounder,TechCrunchawardwinnerYourVersionn PMconsultant:Box,Facebook,MicrosoK,Medallian Founder:LeanProductSiliconValleyTwiMer:@danolsenMyslides:hMp://dan-olsen.com Copyright©2017@danolsen
!"#$%&'()*+*,-"./(0#1#2(##
345$-"0*+./(0#1#2(WX04E#()1%4#;*F1)#&*=19#()1%4#)19;*,9020<04"Y#
#WX04E#()1%4#)19;*,9020<04"#&*=19#67#;*F1)Y#
@*;")0(E4#R#STUV#N-%,*<91,#
XE%4#09#>)*-+&4P!%)'14#
J04Z#
n BookgiveawayonTwiMern Tweet:include@danolsenn Hashtags
#leanstartup#prodmgmt#growth
n hMp:///ny.cc/LPP
That’sWhyIWrote
Copyright©2017@danolsen
Iden/fyhighestROIidea
DesignandImplement
AnalyzeHowtheMetricChanges
BrainstormIdeasto
ImproveMetric
Copyright©2017@danolsen
LeanProductAnaly/csProcess
Iden/fyWhatYourMetricsAre
MeasureMetricsBaselineValues
EvaluateMetricsUpsidePoten/al
GlobalLevel
MetricLevel
SelectTopMetric
Learn&Iterate
H%<+%2<1#4*#\%[1#%#\*<09/,%<"/&9#J)%=1F*)'I#`%[1#!&@<+)1^9#66___c#
H%<+%2<1#4*#\%[1#%#\*<09/,%<"/&9#J)%=1F*)'I#`%[1#!&@<+)1^9#66___c#
H%<+%2<1#4*#\%[1#%#\*<09/,%<"/&9#J)%=1F*)'I#`%[1#!&@<+)1^9#66___c#
H%<+%2<1#4*#\%[1#%#\*<09/,%<"/&9#J)%=1F*)'I#`%[1#!&@<+)1^9#66___c#
H%<+%2<1#4*#\%[1#%#\*<09/,%<"/&9#J)%=1F*)'I#`%[1#!&@<+)1^9#66___c#
Focusonrightmetricatright/me
Iden/fyyour“MetricthatMaMersMost”
(MTMM)
Copyright©2017@danolsen
What’stherightordertoop/mize?acquisi/onconversionreten/on
?5#"*+#&*+<-#*,<"#4)%&'#U#=14)0*#=1%9+)1#"*+)#>)*-+&4P!%)'14#J04C#
FE0&E#=14)0&#F*+<-#04#21Z#
@*;")0(E4#R#STUV#N-%,*<91,#
_141,/*,#_%41#!!_141,/*,#)%41#4)%&'9#FE%4#g#*5#"*+)#&+94*=1)9#%)1#9/<<#%&/[1#*[1)#/=1#
~80% never use app again
Curve either goes to zero or flattens out
@*E*)4#6,%<"909#
@*;")0(E4#R#STUV#N-%,*<91,#
?=;)*[0,(#_141,/*,#_%41#A[1)#D0=1h#?,&)1%90,(#>)*-+&4P!%)'14#J04#
?=;)*[0,(#_141,/*,#_%41#A[1)#D0=1h#?,&)1%90,(#>)*-+&4P!%)'14#J04#
?=;)*[0,(#_141,/*,#_%41#A[1)#D0=1h#?,&)1%90,(#>)*-+&4P!%)'14#J04#
>)*i4#h#_1[1,+1#P#@*94####
## # ##
## # ##
###
###
###
###7,0f+1#H0904*)9##:##6-#_1[1,+1#;1)#H0904*)#
###
###
###
###
###
####
## # #?=;)1990*,9OH0904*)##:##.j1&/[1#@>!#O#UTTT#
## # ##
###
###
###
####
## # ##
## # #H09049OH0904*)##:##>%(1[01F9OH0904##:##?=;)1990*,9O>H#
###
###
###
####
## # ##
## # ##
##k1F#H0904*)9#l#_14+),0,(#H0904*)9#
###
###
####
## # ##
## # ##
###
##?,[041-#H0904*)9#l#7,0,[041-#H0904*)9#
###
>)*i4#h#>)*i4#h#
7,0f+1#H0904*)97,0f+1#H0904*)97,0f+1#H0904*)9
?=;)1990*,9OH0904*)?=;)1990*,9OH0904*)?=;)1990*,9OH0904*)
H09049OH0904*)##:##>%(1[01F9OH0904##:##?=;)1990*,9O>H#
k1F#H0904*)9
?,[041-#H0904*)9
####
## # ##
## # ##
###
###
##]#*5#791)9#31,-0,(#?,[0419##:##?,[0419#31,4O791)##:##?,[041#@*,[1)90*,#_%41#
`1i,1#4E1#.f+%/*,#*5#"*+)#$+90,199#>11<0,(#4E1#A,0*, #
6-[1)/90,(#$+90,199#!*-1<I#
@*;")0(E4#R#STUV#N-%,*<91,#
_1(094)%/*,#>%(1#@*,[1)90*,#_%41#
Daily Signup Page Yield vs. TimeNew Registered Users divided by Unique Visitors to Signup Page
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
1/31 2/14 2/28 3/14 3/28 4/11 4/25 5/9 5/23 6/6 6/20 7/4 7/18 8/1 8/15 8/29 9/12 9/26 10/10
Dai
ly S
ignu
p Pa
ge Y
ield
Changedmessaging
Added questionsto signup page
Started requiringregistration
@*;")0(E4#R#STUV#N-%,*<91,#
Registration Page Conversion Rate vs. Time
Reg
istra
tion
Pag
e C
onve
rsio
n R
ate
H01F#.%&E#!14)0&#%9#%#b%+(1#
@*;")0(E4#R#STUV#N-%,*<91,#
!0,0=+=#>*9902<1#H%<+1#
!%:0=+=#>*9902<1#H%<+1#
@+))1,4#H%<+1#
?-1,/5"0,(#4E1# @)0/&%<#J1F #!14)0&9#
!! XE%4#09#4E1#+;90-1#;*41,/%<#*5#1%&E#=14)0&Z#!! \*F#=+&E#-*#F1#4E0,'#F1#&%,#W=*[1#4E1#,11-<1YZ#!! XE%4#F*+<-#4E1#)1[1,+1#0=;%&4#21Z#!! \*F#=%,"#)19*+)&19#F0<<#04#4%'1#4*# =*[1#4E1#,11-<1YZ#
!! `1[1<*;1)P-%"9C#/=1C#=*,1"#
!! XE0&E#=14)0&9#*j1)#2194#_14+),#*,#?,[194=1,4#d_A?eZ#
@*;")0(E4#R#STUV#N-%,*<91,#
@*;")0(E4#R#STUV#N-%,*<91,#
>)0*)0/a0,(#>)*-+&4#?-1%9#2"#_A?#
?,[194=1,4#d-1[1<*;1)PF11'9e#
_14+),#dH%<+1#@)1%41-e#
8$-*(9(
8$-*(:(
8$-*(;(
8$-*(<(
8$-*(=(
(>(
(>(
?( (@( A(
?(
@(
A(?
D";19#*5#!14)0&#_A?#304+%/*,9#_14+),#
?,[194=1,4#
_14+),#
?,[194=1,4#
_14+),#
?,[194=1,4#
!14)0#b**-#_A?#
!14)0&#$#$%-#_A?#
!14)0&#@#b)1%4#_A?#
@*;")0(E4#R#STUV#N-%,*<91,#
Case Study
@*;")0(E4#R#STUV#N-%,*<91,#
m!#XE0&E#=14)0&#E%9#E0(E194#_A?#*;;*)4+,04"Z#
@%91#34+-"I#A;/=0a0,(#J)01,-941)^9#H0)%<#L**;#
Active Users
Prospective Users
Invite Click
Succeed
Invite click-through rate
Conversion rate
Don’t Click
Fail
Invites per sender
% of users sending invites
m!#!+</;<01-#4*(14E1)C#4E191#=14)0&9#-141)=0,1#"*+)#[0)%<#)%/*#
Users
% of users who are active
= 15% = 2.3
= 85%
Registration Process
@*;")0(E4#R#STUV#N-%,*<91,#
TheUpsidePoten/alofaMetric
0
100%
0
100%
0
?
Registra/onProcessYield
%ofuserssendinginvita/ons
Avg#ofinvitessentpersender
2.3
85%
15%
Maxpossibleimprovement
0.15/0.85=18% 0.85/0.15=570% ?/2.3=?%
Copyright©2017@danolsen
Isanyonefeelingasenseofdéjàvu
rightnow?
DE1#7;90-1#>*41,/%<#*5#%#!14)0&#
T#
UTTg#
T#
UTTg#
T#
Z#
_1(094)%/*,#>)*&199#G01<-#
g#*5#+91)9#91,-0,(#0,[04%/*,9#
6[(#]#*5#0,[0419#91,4#;1)#91,-1)#
SQn#
opg#Upg#
!%:#;*9902<1#0=;)*[1=1,4#
TQUp#O#TQop#h#Uog# TQop#O#TQUp#h#pVTg# Z#O#SQn#h#Zg#
@*;")0(E4#R#STUV#N-%,*<91,#
!14)0&#$#$%-#_A?#
!14)0#b**-#_A?#
!14)0&#@#b)1%4#_A?#
Okay,sohowcanweimprovethemetric?
n Howdoweincreasetheaveragenumberofinvitesbeingsentoutpersender?
n Foreachidea:n What’stheexpectedbenefit?(howmuchwillitimprovethemetric?)
n What’stheexpectedcost?(howmanyengineer-dayswillittake?)
n Youwanttoiden/fyhighestROIidea
Copyright©2017@danolsen
6K1)#L%+,&E0,(#6--)199#$**'#?=;*)41)t#
@*;")0(E4#R#STUV#N-%,*<91,#
AKerLaunchingAddressBookImporter…
Copyright©2017@danolsen
6K1)#L%+,&E0,(#6--)199#$**'#?=;*)41)t#
@*;")0(E4#R#STUV#N-%,*<91,#
Iden/fyhighestROIidea
DesignandImplement
AnalyzeHowtheMetricChanges
BrainstormIdeasto
ImproveMetric
Copyright©2017@danolsen
LeanProductAnaly/csProcess
Iden/fyWhatYourMetricsAre
MeasureMetricsBaselineValues
EvaluateMetricsUpsidePoten/al
MetricLevel
SelectTopMetric
Learn&Iterate
GlobalLevel
Questions? @danolsen http://dan-olsen.com Will notify book winners on Twitter Happy to connect on LinkedIn
