A/B Test Product Info on PDP

2
A/B Test Scorecard: PDP Info Tab Testing on: Fossil DE Hypothesis: If we show users critical shipping and payment info, they will have more trust in and knowledge of the online ordering experience with Fossil and our CVR will increase. Desired Results: Increase in CVR. Current Results: 0.24% increase in CVR from control to test group. Important to note is that data set is still very small for users who clicked on tab. Recommendations: Research exactly what info should be shown. Ensure wording is precise and concise. Make info tab more prominent or preferably do not put behind tab. A/B Test Results Comparison of Conversion Rates: Control vs .Test Conversion Rate 1.59% Conversion Rate 1.75% Goal 1.69% 1.50% 1.55% 1.60% 1.65% 1.70% 1.75% 1.80% Control Group (A) Test Group (B)

Transcript of A/B Test Product Info on PDP

Page 1: A/B Test Product Info on PDP

A/B Test Scorecard: PDP Info Tab Testing  on:  Fossil  DE  

 Hypothesis:  If  we  show  users  critical  shipping  and  payment  info,  they  will  have  more  trust  in  and  knowledge  of  the  online  ordering  experience  with  Fossil  and  our  CVR  will  increase.  Desired  Results:  Increase  in  CVR.  Current  Results:  0.24%  increase  in  CVR  from  control  to  test  group.      Important  to  note  is  that  data  set  is  still  very  small  for  users  who  clicked  on  tab.    Recommendations:  Research  exactly  what  info  should  be  shown.  Ensure  wording  is  precise  and  concise.    Make  info  tab  more  prominent  or  preferably  do  not  put  behind  tab.        

A/B  Test  Results  Comparison  of  Conversion  Rates:  Control  vs  .Test  

       

Conversion  Rate  1.59%  

Conversion  Rate  1.75%  

Goal  1.69%  

1.50%  

1.55%  

1.60%  

1.65%  

1.70%  

1.75%  

1.80%  

Control  Group  (A)   Test  Group  (B)  

Page 2: A/B Test Product Info on PDP

Comparison  of  Conversion  Rates:  Test  vs.  Users  Who  Clicked  Tab    

   Notes  on  data:  Test  data  is  from  12/24/2011  to  1/2/2012.  Approximately  28.7k  participants  were  in  the  test  and  control  groups.    Important  not  is  that  only  153  participants  have  clicked  on  the  PDP  info  tab.    Until  we  have  a  larger  data  set,  we  cannot  be  confident  in  our  data.    

Other  Important  Findings  • Avg  Order  for  Users  who  clicked  tab  is  45%  higher  than  control.    €138.64  vs.  €95.30   •    

Conversion  Rate  1.75%  

Conversion  Rate  14.10%  

0%  2%  4%  6%  8%  10%  12%  14%  16%  

Test  Group  (B)   Users  Who  Clicked  Tab