Optimize your web & mobile sites with Analytics & A/B Testing

62
Optimize your web & mobile sites with Analytics and A/B Testing April 7th, 2016 Solutions Engineer Optimizely Marius Kremeyer Veronique Combaud Product & Partnership Manager AT Internet

Transcript of Optimize your web & mobile sites with Analytics & A/B Testing

Page 1: Optimize your web & mobile sites with Analytics & A/B Testing

Optimize your web & mobile sites with Analytics and A/B Testing

April 7th, 2016

Solutions Engineer

Optimizely

Marius Kremeyer Veronique Combaud

Product & Partnership Manager

AT Internet

Page 2: Optimize your web & mobile sites with Analytics & A/B Testing

Welcome to Optimizely Connect

Page 3: Optimize your web & mobile sites with Analytics & A/B Testing

Veronique Combaud

Product & Partnership Manager

[email protected]

Your presenters for today

Marius Kremeyer

Solutions Engineer

[email protected]

Page 4: Optimize your web & mobile sites with Analytics & A/B Testing

-­ Duration: 45 Minutes

-­ Ask questions at any time

-­ Use the question panel

-­ We will answer qs at the end

-­ Slides & recording will be

sent out after the webinar

Housekeeping

Page 5: Optimize your web & mobile sites with Analytics & A/B Testing

AT  Internet  &  Optimizely   introduction

Fundamentals:  

How  to  use  analytics  to  discover  the  weak  spots  on  your  website

Hypothesis  generation   to  start  AB  testing

Use  cases:  media   &  e-­commerce

How  to  integrate   AT  Internet  and  Optimizely  in  one  click

Q&A

Our program for Today

Page 6: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  SolutionsDigital  Intelligence  Solutions

INTRODUCTIONOPTIMIZELY  &  AT  INTERNET  

Page 7: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

INTRODUCTION

55%of  business  leaders  consider  that  the  analysis  of  analytics  data helps  to  bring  new  revenue  sources  to  the  company.

Source   :  international   study   KPMG  and   The  Economist   Intelligence   Unit   (2014)

Page 8: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

INTRODUCTION

97%of  marketers  think  A/B  testing  is  useful  or  even  essential  for  59%  of  them.

Source   :  Converteo   &  Fevad   on  250   companies   in  France

Page 9: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

98% of respondents state optimization is valuable to their success

Source:   Optimization   Benchmark   Report,  2015

INTRODUCTION

Page 10: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

Which of the following inform your optimization strategy?

Source:   Optimization   Benchmark   Report,  2015

INTRODUCTION

Page 11: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

INTRODUCTION

AMELIORER  LEUR  PERFORMANCEHelping  companies  to  IMPROVE  THEIRPERFORMANCE

by TURNING  DATA  INTO  VALUE

AT Internet & Optimizely are

Page 12: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

AT INTERNET

ANALYTICS  SUITE

Page 13: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

AT INTERNETOUR CLIENTS ARE MARKET LEADERS

TRAVELE-­COMMERCEFINANCE GOVERNMENTINDUSTRYMEDIA

Page 14: Optimize your web & mobile sites with Analytics & A/B Testing

Optimizely enables you to… Create alternative variations of your homepage, product -or landing pages with ease and run A/B- and Multivariate Tests.

Target specific audiences such as: New vs. returning, Geo-Location, Ad-Campaign, URL, Cookie etc.

Understand the impact of your tests through analytics

Connect the essential data from visitor behavior, 1st-party and 3rd-party sources for even more insights.

Page 15: Optimize your web & mobile sites with Analytics & A/B Testing

How it works...

Page 16: Optimize your web & mobile sites with Analytics & A/B Testing

10,000

Adobe

GWO

VWO

SiteSpect

Monetate

Maxymiser

Qubit

2,000

0

4,000

6,000

8,000Optimizely

Source: BuiltWith

Num

ber o

f site

s

Optimizely is the market leader in Experience Optimization

Page 17: Optimize your web & mobile sites with Analytics & A/B Testing

Over 6.000 businesses optimize with Optimizely

Page 18: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  SolutionsDigital  Intelligence  Solutions

FUNDAMENTALS3  STEPS  TO  START

Page 19: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

3 STEPSTO START

Page 20: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

USE CASESMEDIA  &  E-­COMMERCE

Page 21: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

1ST USE CASE: MEDIA

Analyse  your  website

Detect  pain  points

Build  hypothesis  &  test

Page 22: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 1: ANALYSE YOUR KPIS WITH YOUR AT INTERNET PLATFORM

Page 23: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 2: … AND DETECT PAIN POINTS

Page 24: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 3: CREATE A HYPOTHESIS FOR AN A/B TEST

Problem:

› Not  enough  visitors  are  (re)  engaging   and   reading  our  articles

Potential  Solution:

› Make  newsletter  sign-­up  more  prominent

Hypothesis:

› By  placing  a  more  explicit  CTA  in  the  left  corner  of  the  homepage,   more  visitors  will  see  and  sign  up  for  our  newsletter.  A  newsletter   is  a  great  way  to  re-­engage   our  readers.

Page 25: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  can  we  get  more  people  to  sign  up  for  the  newsletter?

Original Variation   in  Optimizely

Page 26: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  can  we  get  more  people  to  sign  up  for  the  newsletter?

Original Variation   in  Optimizely

Page 27: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  can  we  get  more  people  to  sign  up  for  the  newsletter?

Original Variation   in  Optimizely

Page 28: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  can  we  get  more  people  to  sign  up  for  the  newsletter?

Original Variation   in  Optimizely

Page 29: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 1: ANALYSE YOUR KPIS WITH YOUR AT INTERNET PLATFORM

Page 30: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 2: … AND DETECT PAIN POINTS

Page 31: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 3: CREATE A HYPOTHESIS FOR AN A/B TEST

Problem:

› The  number  of  premium  stories  viewed  and  bought  has  decreased  by  10%

Potential  Solution:

› Improve  our  default   subscription  page

Hypothesis:

› By  adding   images   for  the  subscription  packages,  visitors  will  find   the  offering  more  appealing   and  thus  a  higher  percentage  of  visitors  will  convert  vs.  the  page  without  images.

Page 32: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELY

Original

What  would  help  more  people  subscribe  to  premium  content?

Variation   in  Optimizely

Page 33: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELY

Original

What  would  help  more  people  subscribe  to  premium  content?

Variation   in  Optimizely

Page 34: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

2ND USE CASE: E-COMMERCE

Analyse  your  website

Detect  pain  points

Build  hypothesis  &  tests

Page 35: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 1: ANALYSE YOUR KPIS WITH YOUR AT INTERNET PLATFORM

Page 36: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 2: … AND DETECT PAIN POINTS

Page 37: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 3: CREATE A HYPOTHESIS FOR AN A/B TEST

Problems:

› Sales  from  discounts  have  decreased  30%

Potential  Solution:

› Making   the  “Sales  &  Offers”  element   more  prominent

Hypothesis:

› By  moving  the  “Sales  &  Offers”  element   in  the  navigation   to  the  left  and  highlighting   the  text,  more  people  will  notice   it,  and  we  will  see  an  increase  in  sales  from  discounts.

Page 38: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  do  we  get  more  visitors  to  purchase  discounted  items?

Original Variations   in  Optimizely

Page 39: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  do  we  get  more  visitors  to  purchase  discounted  items?

Original Variations   in  Optimizely

Page 40: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  do  we  get  more  visitors  to  purchase  discounted  items?

Original Variations   in  Optimizely

Page 41: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  do  we  get  more  visitors  to  purchase  discounted  items?

Original Variations   in  Optimizely

Page 42: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 3: CREATE A HYPOTHESIS FOR AN A/B TEST

Problems:

› Orders  from  repeat  buyers  have  decreased  by  19%

Potential  Solution:

› Create  a  buying  incentive   for  repeat  visitors

Hypothesis:

› By  adding  a  prominent   lightbox  with  a  personalized  greeting   &  discount  for  repeat  visitors,  we  will   increase  the  likelihood   that  this  group  orders  again.

Page 43: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELYHow  can  we  increase  purchases  from  returning  visitors?

Original Variation   in  Optimizely

Page 44: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 1: ANALYSE YOUR KPIS WITH YOUR AT INTERNET PLATFORM

Page 45: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 2: ANALYSE YOUR KPIS WITH YOUR AT INTERNET PLATFORM

Page 46: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 3: CREATE A HYPOTHESIS FOR A MOBILE A/B TEST

Problems:

› App  Pageviews  have  decreased  by  15%

Potential  Solution:

› Adding  a  “Like”-­Functionality   to  

Hypothesis:

› Some  users  might  not  be  ready  to  purchase  an  item,  but  would  like  to  indicate  preference  and  continue   later.  By  adding   a  soft  CTA,  “Like”,  more  users  will  engage  with  the  app.    

Page 47: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELY

Original

What  would  help  more  people  engage  with  our  app?

Variation   in  Optimizely

Page 48: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELY

Original

What  would  help  more  people  engage  with  our  app?

Variation   in  Optimizely

Page 49: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

STEP 4: TURN YOUR IDEA INTO A TEST VARIATION WITH OPTIMIZELY

Original

What  would  help  more  people  engage  with  our  app?

Variation   in  Optimizely

Results:

-­ 10%  more  engagement  in  variation  with  Like-­Button

-­ 9%  more  merchandise  requests  in  variation  with  Like-­Button

Page 50: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  SolutionsDigital  Intelligence  Solutions

INTERCONNECTIONINTERCONNECTIONHow  to  start?

Page 51: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

PARTNERSHIP

✓ Reduce tracking implementation time in one click✓ Consolidate all data for global analyses and data interpretation

PRINCIPLES  &  BENEFITS

Page 52: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

1. SET UP A TESTOPTIMIZELY  INTERFACE

Page 53: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

2. AT Internet TagACTIVATE  CONNECTION  IN  ONE  CLICK

Page 54: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

2. AT INTERNET TAGACTIVATE  CONNECTION  IN  ONE  CLICK

Page 55: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

3. ANALYSE A/B TEST IN OPTIMIZELY

› Optimizely  will  indicate   the  « Winner  variation »  according   to  the  goals  specified   for  the  test

› But  is  it  also  the  winner  according  your  most  important   website  objectives  and  KPIs?  

GET  AN  OVERVIEW  OF  HOW  THE  DIFFERENT  VARIATIONS  PERFORM  IN  OPTIMIZELY

Page 56: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

4. GO FURTHER WITH AT INTERNET ANALYTICS SUITEFOCUS  ON  A  SPECIFIC  POPULATION

website segment

➔ Sources➔ Conversions➔ Navigation➔ Retention➔ Etc...

➔ Sources➔ Conversions➔ Navigation➔ Retention➔ Etc...

Ex:  Have  seen  the  variation  A

Page 57: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

4. GO FURTHER WITH AT INTERNET ANALYTICS SUITESEGMENTATION  IN  DATA  QUERY

Page 58: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

4. GO FURTHER WITH AT INTERNET ANALYTICS SUITE

Variation  #1 Variation  #2

CREATE  YOUR  OWN  VISUALISATION  IN  OUR  DASHBOARD  APP

Page 59: Optimize your web & mobile sites with Analytics & A/B Testing

Digital  Intelligence  Solutions

SUMMARY

› Make  careful  changes to  user  experiences  while  collecting  data  on  the  results

› Validate  your  test  upon  KPIs  and  track  the  entire  customer  journey for  each  Optimizely  variation  visitor

› Ensure  there  is  no  deterioration  of  your  main  or  secondary  objectives

› Continually  improve  a  given  experience  like  conversion  rate  over  time

A  POWERFUL  INTEGRATION

Page 60: Optimize your web & mobile sites with Analytics & A/B Testing

Questions?

Page 61: Optimize your web & mobile sites with Analytics & A/B Testing

Veronique Combaud

Product & Partnership Manager

[email protected]

Thank you!

Marius Kremeyer

Solutions Engineer

[email protected]

Page 62: Optimize your web & mobile sites with Analytics & A/B Testing

Sign up for our last Connect Webinar!

Time: 11:00 CET

45 Minutes

Sign up here