Post on 14-Aug-2015
Reading Between the Lines: Get the Most Out of Your Results Page
#opticon2015
Khattaab KhanStrategy Consultant, Optimizely
@khattaabkhankhattaab@optimizely.com
Undergraduate-LevelResults Analysis
Undergraduate-Level Results Analysis
Performance Summary Audience Segmentation
Statistics
Undergraduate-Level Results Analysis Performance Summary
1. How many unique visitors ran through my experiment?
2. How long did it run? 3. Did any variations achieve statistically
significant conversion lift?
Questions you should be able to answer in a glance
Undergraduate-Level Results Analysis Audience Segmentation
1. Did any segments show conversion trends drastically different than the total sample?
2. Are my custom segments capturing a meaningful volume of traffic?
Questions you should be able to answer in a glance
Undergraduate-Level Results Analysis Statistics
1. What is the value of 2-tailed analysis 2. Does the demonstrated lift
improvement exceed my pre-determined MDE (Opportunity Costs)
3. What is the Difference Interval range?
Questions you should be able to answer in a glance
What Sets Apart Basic Results Analysis from
Advanced?
Organization
Organize Test Plans + Results to Maximize Reach of Testing
Program
Roadmap Summarizes Test Plan + Results Detailed Assessment
Roadmap Visualization
Roadmunk Software
Shared Variation Design Archive
Shared Variation Design Archive
Shared Variation Design Archive
Let’s Get More Organizedwithin Optimizely
#ExperimentLabels
#ExperimentLabels
#ExperimentLabels
Extract More Value Out ofOptimizely Event Tracking
Alternate Metric Axes
Alternate Metrics
Consider Correlation Between Traffic Waves
and Variation Performance
Traffic Volume
Chart Annotation
Provide Visibility intoExternal Influences
Chart Annotation
Organize data to effectively communicate results; implement analytics integrations
Takeaways
Leverage advanced results page features to distill metrics that matter to your organization
Maximize reach of results sharing
#opticon2015
Q&A
Khattaab KhanStrategy Consultant, Optimizely
@khattaabkhankhattaab@optimizely.com