Introducing a culture of testing & optimisation

38
Introducing a culture of testing & optimisation Doing more than just getting the shoes on the shelf. Stuart McMillian Schuh LTD. Deputy Head of Ecommerce @mcmillans tu

description

Introducing a culture of testing & optimisation, Doing more than just getting the shoes on the shelf.

Transcript of Introducing a culture of testing & optimisation

Page 1: Introducing a culture of testing & optimisation

Introducing a culture of testing & optimisation Doing more than just getting the shoes on the shelf.

Stuart McMillianSchuh LTD.

Deputy Head of Ecommerce

@mcmillanstu

Page 2: Introducing a culture of testing & optimisation

Who is this guy?!

• Scottish

• Geek

• Favourite board game: Monopoly

@mcmillanstu

Page 3: Introducing a culture of testing & optimisation

What we’ll cover• The schuh context

• Building a testing culture

• The new normal

• Tomorrow’s world

@mcmillanstu

Page 4: Introducing a culture of testing & optimisation

The schuh context

@mcmillanstu

Page 5: Introducing a culture of testing & optimisation

A bit of schuh background• Founded 1981• 99 stores• Multichannel• Customer

service focused• Systems driven

@mcmillanstu

Page 6: Introducing a culture of testing & optimisation

Ecom Challenges – A multi device world

@mcmillanstu

Page 7: Introducing a culture of testing & optimisation

Ecom Challenges – A multi device world

@mcmillanstu

P1 P2 P3 P4 P5 P6 P7 P8 P9 P10 P11 P12 P1 P2 P3 P4 P5 P6 P7 p8 p9 p10 p11 p12 P1 P2 P3 P4 P5 P60%

10%

20%

30%

40%

50%

60%

70%

80%

90%

Traffic by device since

Feb 2012

DesktopMobileTablet

Page 8: Introducing a culture of testing & optimisation

Ecom Challenges – A multi device world

@mcmillanstu

Results you can’t always measure

Page 9: Introducing a culture of testing & optimisation

Ecom Challenges – A multi device world

@mcmillanstu

Increasingly competitive marketplace

Page 10: Introducing a culture of testing & optimisation

Ecommerce

Mobile Site November 2011

Tablet Site November 2012

Responsive Pilot November 2013

Schuh Responsive August 2014

Trading Online2001

@mcmillanstu

Page 11: Introducing a culture of testing & optimisation

Head of Ecommerce

Deputy Head of Ecommerce

Digital Marketing

Digital Merchandising

Online Development &

Optimisation

Web Editorial Analytics Insight

Ecommerce – Team Structure

@mcmillanstu

Page 12: Introducing a culture of testing & optimisation

What is a good user experience?

@mcmillanstu

Page 13: Introducing a culture of testing & optimisation

Building a testing culture

@mcmillanstu

Page 14: Introducing a culture of testing & optimisation

This is not an anti-agency rant…

@mcmillanstu

Page 15: Introducing a culture of testing & optimisation

Status Quo Ante

• Conversion focused• Systems driven• Customer-centric• Self Reliant

• ‘Project cycles’• Backlog/Dev resource• Poor instrumentation• Self Reliant

Strengths Weaknesses

@mcmillanstu

Page 16: Introducing a culture of testing & optimisation

The watershed moment

@mcmillanstu

Page 17: Introducing a culture of testing & optimisation

Stop, collaborate and listen

@mcmillanstu

Page 18: Introducing a culture of testing & optimisation

Teamwork

@mcmillanstu

Ecommerce

Designer (Marketing

dept)Customer

Service

Ecommerce

User

Page 19: Introducing a culture of testing & optimisation

Growing the team, widening the effort

•Identify bottlenecks, resource appropriately • Democratisation of

effort to entire department & beyond

@mcmillanstu

Page 20: Introducing a culture of testing & optimisation

Tools of the trade

@mcmillanstu

Page 21: Introducing a culture of testing & optimisation

Training, Development & SupportBroaden Horizons • GA• PRWD• Optimizely • Conferences• The Internet!

Set New Standards1. Mobile first2. User-centric design3. Standards compliant4. Analytics ready5. SEO as standard

@mcmillanstu

Page 22: Introducing a culture of testing & optimisation

Areas of improvement

@mcmillanstu

HypothesisCreation

Page 23: Introducing a culture of testing & optimisation

Areas of improvement

@mcmillanstu

These aren’t the results you’re looking for

Test Analysis

Page 24: Introducing a culture of testing & optimisation

Areas of improvement

@mcmillanstu

Evangelisefurther

Page 25: Introducing a culture of testing & optimisation

Danger!

Don’t build new walls!

@mcmillanstu

Page 26: Introducing a culture of testing & optimisation

The New Normal

@mcmillanstu

Page 27: Introducing a culture of testing & optimisation

Responsive Web Design

@mcmillanstu

Page 28: Introducing a culture of testing & optimisation

Mobile First

@mcmillanstu

What does that even mean?!

“It’s not a device, it’s a context!” Another guru“It’s a paradigm shift” Some guru

“It’s just a smaller screen” Yet another guru

Page 29: Introducing a culture of testing & optimisation

Mobile First – A practical approach

@mcmillanstu

Smartphone represents our largest audience segment They have the biggest hardware challenges

Slow connection Small screen

Technically challenging to down-scale an experience to mobile Other devices can “afford” to pick up the overhead of up-

scaling from mobile We treat mobile as our baseline, if something is important to

how we do e-business it starts on mobile (SEO, for example)

Mobile design is bleeding in to desktop design (thankfully).

Page 30: Introducing a culture of testing & optimisation

Mobile First – Challenges

@mcmillanstu

2013 Eptica Mobile CX study lists the top 3 consumer pet-hates: Sites that lack functionality compared to desktop sites Sites that were slow to load Sites that were difficult to navigate on a small screen

Usability best practice for 2014/2015 must address these!bare minimum

Page 31: Introducing a culture of testing & optimisation

Mobile First – Best Practice

@mcmillanstu

Where I think we should be aiming: Search-ready. Turn off styles, how does it look? Sites that load in 1-2 seconds via 3G App-like Interaction Design, fully realising touch Seamless user journeys between screens Integrated fully with physical retail Retail infrastructure needs to adapt to mobilised consumer

(e.g. fulfilment options)

Page 32: Introducing a culture of testing & optimisation

Mobile First – Speed Tips

@mcmillanstu

A few things to think about: Perception is everything. It’s not about the numbers, it’s

about how the user perceives the speed of your site.

For mobile, the network layer is still very much the major bottleneck. Optimising for available bandwidth is key. 4G won’t fix this!

Page 33: Introducing a culture of testing & optimisation

Tomorrow’sWorld

@mcmillanstu

Page 34: Introducing a culture of testing & optimisation

@mcmillanstu

High street innovationInnovation of the mundane: Many retailers still working towards a single view of stock

Fulfilment options not yet meeting customer expectations

Integration of offline and online still very basic

Payment technologies could be improved

Page 35: Introducing a culture of testing & optimisation

@mcmillanstu

Apps

The App is DeadLong Live the App?

Page 36: Introducing a culture of testing & optimisation

@mcmillanstu

Page 37: Introducing a culture of testing & optimisation

@mcmillanstu

If you always do what you’ve always done, you’ll always get what you always got

Page 38: Introducing a culture of testing & optimisation

Contact InfoStuart McMillanSchuh LTD.Deputy Head of EcommerceEmail: [email protected]

@mcmillanstu

Questions?