Customer Case study

Userzoom has given us another string to our bow by providing invaluable qualitative and quantitative insight from remote usability testing. Our internal research and usability team benefited from Userzoom’s capability to conduct research at scale, and the quick turnaround of this feedback has been a key factor in helping us to launch our new Ryanair website.

Mark Kelly, Head of Research and Usability

at Ryanair Labs

Customer Case Study Ryanair

All-in-One Platform to Rapidly Test Usability & Measure User Experience

Introduction Ryanair is one of the most recognizable airlines in Europe known for democratizing air travel for the masses. Ryanair has orders for a further 380 new Boeing 737 aircraft, which will enable the company to lower fares and grow traffic from 105m passengers in 2016 to 180m p.a. in 2024. Ryanair has a team of more than 10,000 highly skilled aviation professionals.

Challenges: “Status quo before testing”In 2014, Ryanair set about changing the perception of the company, by launching an initiative aimed at improving customer experience. Ryanair’s approach was called ‘Always Getting Better’.

At around the same time, the airline launched Ryanair Labs, a digital and IT innovation hub based in Dublin which sought to “change the world of online travel”. They began a massive recruitment drive for over 200 roles including digital marketers, software developers, data analytics specialists and user experience (UX) and design professionals. The airline’s plan is to turn its website — which attracts 50m hits a month — into an online travel platform.

User experience (UX) was quickly recognized as a key area of focus and the UX team grew to 25 people as part of the wider digital team at Ryanair Labs. From the

Customer Case Study Ryanair

All-in-One Platform to Rapidly Test Usability & Measure User Experience

fleet over 300 Boeing 737

aircraft

connecting 200 destinations in

31 countries

more than 1,800 daily flights from

78 bases

Ryanair at a glance

“what they really needed was a research partner who could help

deliver large scale quantitative insights

from remote user testing”.

Customer Case Study Ryanair

All-in-One Platform to Rapidly Test Usability & Measure User Experience

outset, design research was seen as an important part of keeping the user at the center of everything Ryanair was doing, by providing actionable insight to improve the experience of the customer.

An ambitious target for the team was the development and launch of a brand new Ryanair website by the end of 2015. The new site was a key part of the wider ‘Always Getting Better’ program and had a number of enhancements including drastically reducing the number of steps required to book a flight, an enhanced account section, allowing regular travelers to store information about their travel documents and payment card, and delivering a better, more consistent experience across mobile devices and channelsThe Research team at Ryanair had its own panel, and some external support from third party suppliers to conduct benchmarking, but what they really needed was a research partner who could help deliver large scale quantitative insight from remote user testing.

Solution: “Proven UX testing approach to improve situation” The Ryanair research team chose to utilize Userzoom’s remote usability testing expertise with task-based research, which measured the user experience of 100 people per test. The tasks assessed specific user scenarios such as how to select the cheapest fare or book certain travel dates. Users were timed and recorded as they navigated the Ryanair test site to complete these set objectives. Tests were also created to measure first impressions, discoverability and the ‘look and feel’ of the website from early prototype development through to launch.

The strategy was for the unmoderated testing to generate a mix of qualitative and quantitative data, and for these tests to be conducted in more phases than before. UserZoom has allowed Ryanair to increase the numbers of users involved in the research process and at the same

“The strategy was for the unmoderated testing

to generate a mix of qualitative and quantitative

data, and for these tests to be conducted in more

phases than before.

time enabled them to deliver the results back to the organization quicker than ever before. This enabled the UX research and usability testing to fit seamlessly into the rapid, agile development cycle in Ryanair Labs

It was critical that the testing was carried out across all channels – Smartphone, Tablet and Desktop – and on different platforms (Android, iOS, Windows) as one of the key upgrades to the new Ryanair website was to implement a responsive website design. The research was designed to test, iterate and validate a consistent, seamless experience for users on all devices and on every platform.

In addition, Ryanair ran some of the same scenario tests on the websites of competitors, providing the research team with benchmarking insight. Direct competitor and industry wide benchmarking is something the company is now conducting continuously thanks to the ability of Userzoom to perform such testing on a regular basis. Key to the business’ new digital strategy is a commitment to “be disruptive in it’s vertical and to provide its customers with the best experience through our platform.” Ryanair is able to compare UX performance and ensure this goal is being achieved through regular benchmarking.

Results: “How did UX testing improve the ROI?” Userzoom helped Ryanair build a better user experience for its website, which launched in November 2015. Large sample sizes across different mobile platforms and devices identified opportunities for improvement in a rapid, iterative time-boxed process. User feedback reinforced decisions that were made in the platform redesign and helped ensure development milestones were achieved. As a result, Ryanair’s development and UX teams were able to make informed decisions based on real data, in real-time.

Customer Case Study Ryanair

All-in-One Platform to Rapidly Test Usability & Measure User Experience

It was critical that the testing was carried out across all channels – mobile, tablet and PC – and on different platforms (Android, iOS, Windows)

The remote testing gave us scale and

reach in the design testing process, and a wealth of data that we did not have access to

before.

Customer Case Study Ryanair

All-in-One Platform to Rapidly Test Usability & Measure User Experience

About Userzoom

UserZoom is the All-in-One Platform to Rapidly Test Usability & Measure User Experience. Our ‘Worry-Free’ solution

offers a quantitative and qualitative research platform to help UX/CX, Product Managers and Marketing professionals

test and measure all aspects of their web and mobile properties.

“Having a brand like Ryanair who truly understands the value of the Remote Unmoderated Testing has been fantastic. We have been working with them and supporting their testing roadmap since September 2014, they truly pushed UserZoom’s capabilities over the 12 month period up to the new site going live with more than 30 tests collecting feedback from thousands of participants. We look forward to working with them throughout 2016 as they further innovate and test their digital offering.”Arthur Moan, Client & Professional Services Director / EMEA at UserZoom

Rui Pereira, Senior UX Researcher at Ryanair Labs, said

Userzoom provided the research with a quick turnaround which was critical in the period

leading up to the launch of the new website. Previously, we had a reliance on lab based, face-to-face usability testing. Typically these sessions would take circa 2 to 3 weeks to plan, conduct and report and focused on a targeted profile sample of 10-20 users. This reliance caused significant bottlenecks for us in terms of our testing schedule versus our development schedule. Now, with Userzoom, and the same budget, we have more flexibility to conduct simultaneous tests with hundreds of users, across our international markets and turnaround these activities in line with our development schedule, while still having resources to conduct other research streams too. The remote testing gave us the scale and reach in the design testing process, and a wealth of data that we did not have access to before. The insight was fed into the design team quickly through an agile and lean reporting process, much to the delight of our UX and development teams who were working to tight deadlines.”

www.linkedin.com/company/userzoom

UserZoom USA

SAN JOSE10 Almaden Blvd #250, San Jose, CA 95113Phone: 866-599-1550

@UserZoom

Contact Information

UserZoom UK

LONDONOffice 143, Southbank House, Black Prince Road,London E1 7SJPhone: + 44 (0) 20 356 70721

UserZoom Spain

BARCELONAAv. Diagonal 618 3o D 08030 Barcelona, SpainPhone: +34 93 414 7554

UserZoom Germany

MÜNCHENAinmillerstr. 11 80801 MünchenPhone: +49 (0) 89 45 3535 25

@userzoom_de

MADRIDCalle Fortuny 3 2o izqda. 28010 MadridPhone: +34 915 426 252

@UserZoom_SP

CHESHIRE4-6 Bank Square, Wilmslow, Cheshire SK9 1ANPhone: + 44 (0) 1625 525 650

@userzoom_UK

SAN FRANCISCO665 3rd St., Suite 100 San Francisco, CA 94107Phone: 866-599-1550

@UserZoom

UserZoom is an All-in-One Enterprise software solution for Online User Experience Research. Our ‘Worry-Free’ solution offers a Quantitative and Qualitative research platform to help UX/CX, Product Managers and Marketing professionals test and measure all aspects of their web and mobile properties.