Test script

17
Test Script - Tourism BC Round 2 Tourism BC Australian Site (TB5001) June 2022 Test Script - Tourism WA Round 2 Project: Tourism WA Site (TB6001) Date: Monday, 6 June 2022 Purpose Of User Testing Round Two To test the modified pages included the clickable prototype for usability and usefulness to an Australian audience. To test the lower level content of the current North American version of hellobc.com for usability & usefulness to the Australian audience. To investigate the Australian attitude towards advertising, sponsored links or buying travel products online via an official unbiased information resource based site. This feedback will be used to evolve the prototype for round 3 of user testing and will eventually inform the final wireframe specification for the Australian Tourism BC website Target Audience Segment 1 Segment 2 Segment 3 Keen & active skiers – usually take at least one local ski trip a year Older traveller looking for “once in a lifetime” travel experiences Independent traveller looking for work opportunities

description

 

Transcript of Test script

Page 1: Test script

Test Script - Tourism BC Round 2

Tourism BC Australian Site (TB5001) April 2023

Test Script - Tourism WA Round 2Project: Tourism WA Site (TB6001)

Date: Sunday, 9 April 2023

Purpose Of User Testing Round Two To test the modified pages included the clickable prototype for usability

and usefulness to an Australian audience.

To test the lower level content of the current North American version of hellobc.com for usability & usefulness to the Australian audience.

To investigate the Australian attitude towards advertising, sponsored links or buying travel products online via an official unbiased information resource based site.

This feedback will be used to evolve the prototype for round 3 of user testing and will eventually inform the final wireframe specification for the Australian Tourism BC website

Target Audience

Segment 1 Segment 2 Segment 3

Keen & active skiers – usually take at least one local ski trip a year

Older traveller looking for “once in a lifetime” travel experiences

Independent traveller looking for work opportunities overseas

Round ONE: 3 participants of this segment

14/12/05: 14:00PM

15/12/05: 16:00PM

16/12/05: 13.00PM

Round ONE: 3 participants of this segment

14/12/05: 16:30PM

15/12/05: 12:00PM

16/12/05: 11:00AM

Round ONE: 3 participant of this segment

14/12/05: 12:00PM

15/12/05: 12:00PM

Age range: 25 – 45 Age range: 60+ Age range: 18 – 30

Page 2: Test script

Test Script - Tourism BC Round 2

2Tourism BC Australian Site (TB5001) April 2023

Segment 1 Segment 2 Segment 3

(possibly retired)

Have recently been on or are planning an overseas ski holiday in the next year (around two to three weeks in duration

Have recently been on or are planning a long haul overseas holiday (around 6 weeks in duration)

Have recently been on or are planning an extended overseas trip including a working holiday (more than 3 months in duration)

Prefers outdoors/activity based holidays

Prefers organised tour based holidays

Prefers independent travel

50/50 Mix of Males to Females

All should be keen travellers – have recently been on or planning an overseas holiday

All should be Australians by birth or have lived in Australia for an extended period of time (long enough to call Australia home).

None of the participants should be North American (from Canada or US) or Australians that have lived in Canada or the States for an extended period of time

All participants should be reasonably comfortable online. They should use the internet to conduct research for their holidays.

Page 3: Test script

Test Script - Tourism BC Round 2

3Tourism BC Australian Site (TB5001) April 2023

Session Details

LocationAll sessions will be held at the following location:

City Group Rooms

Level 11, 60 York Street,Sydney, NSW 2000

Tel: Andrew or Patrick on (02) 9299 8907

Equipment Laptop with internet connection

Prototype on desktop

Morae Software to capture computer screen during sessions

Web Cam

Test plan/notes

Incentive Payments (8 x $65 = $345.00)

Dates The sessions will be one-on-one, in other words, one facilitator and one

participant.

Session duration 1 to 1.5 hours.

Testing is scheduled to happen on Wednesday 14th December (3 participants), Thursday 15th December (3 participants) & Friday 16th

December (2 participants)

Incentives Participant incentives have been budgeted at $65 per person.

Page 4: Test script

Test Script - Tourism BC Round 2

4Tourism BC Australian Site (TB5001) April 2023

Test Script

Step 1: Introduction and signing release forms. (5 minutes) “First of all, I would like to thank you for coming. We’ve asked you to

come along today to discuss a website that we are currently working on for an overseas tourism association. They have asked us to develop an Australian version of their North American website. We want to talk to Australians travellers, like yourself, to understand what your needs would be when planning a trip overseas so we can create a website that you would want to use.”

“Firstly we will ask you a few questions about yourself and how you use the internet, and then we will spend a little time going through a mock-up of the Australian website that we have created. The mock up, or prototype, includes high level pages that have been created specifically for an Australian audience.

We call it a prototype because not all the pages function as you would expect normal website to work, for example, not all the links work and some of the pages don’t contain real content, but even so it should give you a pretty good idea of how we are planning to build these pages.

Some of these mock up pages then link through to the real current North American website, therefore sometimes you might notice small changes in the design and website navigation – this will be because you’ve clicked out of the prototype and into the North American website. Occasionally I might ask you to click on this button here (point to bookmark at top of browser) to bring us back into the Australian website pages.”

As we go along through the website, I’m going to ask you to think out loud, to tell me what’s going through your mind. This will help us to understand better what problems you might be facing or things that you like or dislike about the website”

“I want to make it clear right away that this session is to see how useful the website design is, so it is important that you just do what you normally would. You can’t do anything wrong here.”

“We want to hear exactly what you think. We are independent evaluators, so you can’t hurt our feelings. To make the best recommendations, we need to know honestly what you think.”

“If you have any questions, just ask. I may not be able to answer then right away, since we’re interested in how people do when they don’t have someone sitting next to them to help them through it, but I will try to answer any questions you still have when we’re done”

“if you need a break at any time, just let me know and we’ll stop the session”

“Do you have any questions before we begin?”

Page 5: Test script

Test Script - Tourism BC Round 2

5Tourism BC Australian Site (TB5001) April 2023

We would like to record this session to refer to later on when writing up the notes of this session. They will not be used for market research or distributed to anyone outside the project. Are you ok with this? Can you sign the permission form?

Step 2: Find out about the person and their attitude towards travel and the internet (10 minutes)

Questions would be directed to all participants:

o How often do you use the internet?

o What kinds of things do you do on the internet?

o How often do you travel – domestically and overseas?

o Where and when was your last holiday?

o What kind of holidays do you enjoy most?

o Are you planning to travel in the next year or so? Where to?

o Do you use the internet to research your holidays?

o Think back to the last time you used the Internet to research or book a holiday. What did you do?

o Is this typical, or would you normally do something else?

o Do you ever purchase travel products online? If so, what and when?

o What do you know about holidaying in Canada?

o Do the initials BC mean anything to you?

o What do you know about British Columbia?

o Where in Canada do you think British Columbia is located?  (will take print out of Canada map outline)

Step 3: Prototype Review (50 to 70 minutes)

The following questions will be directed to segment type: Keen & active skiers

Say that your want to start researching for a ski trip next year overseas somewhere. You’ve heard good things about the ski resorts in Canada and you want to find out more about which ones will be suitable for you and your travelling companions. How do you start to find the information you want?

What search engine do they use?

What search terms do they input into the search engine?

What makes them click on a particular link in search results?

What information are they looking for?

Page 6: Test script

Test Script - Tourism BC Round 2

6Tourism BC Australian Site (TB5001) April 2023

You’ve heard from friends that the website of the official tourism organisation of British Columbia is a great resource of ski resort information, how do you find this website?

What search terms to they enter?

What makes them click on a particular link in the search results?

What key words are they looking for?

Ask the participant to select the prototype from the bookmarks link:

What are your first impressions of this page?

How do you find out if British Columbia is a place you would like to visit?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Is this information what you would expect to find?

Is there any additional information that you would require

What time of year would you most like to visit?

How do they find the answer to this question?

What links do they click on?

Is this information what you would expect to find?

How do you find out if you need a visa to holiday in British Columbia?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Is this information what you would expect to find?

Is there any additional information that you would require

What clothes would you need to bring if travelling to Northern BC in winter?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Imagine that this will be your first ski trip to this part of the world and you’re concerned that keeping safe on the mountain might be slightly different from Australia or Europe – how do you find out about safety information on BC’s slopes?

Page 7: Test script

Test Script - Tourism BC Round 2

7Tourism BC Australian Site (TB5001) April 2023

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Find a list of all the ski-resorts in British Columbia and view information about a resort that you’ve heard may be interesting to visit?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What resorts do they pick to view more details of?

Is this information what you would expect to find?

Is there any additional information that you would require?

You decide that you want to go to <Whistler> for your next ski trip. How do you find out which airport to fly to?

Is this information important to know before you go? How would you normally figure out these details?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

Is this information what they would expect to find?

Is there any additional information that they would require?

Imagine that usually your overseas ski trips contain more than one ski resort, as well as the ski resorts in British Columbia, you’ve heard that the resorts in other parts of Canada, for example, Alberta, are also just as good. How to do find out about resorts in Alberta?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

As your flying into Vancouver to get to Whistler, you decide to spend a weekend there before heading over to the ski resorts. Find a list of things to do in Vancouver?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

Is this information what you would expect to find?

Is there any additional information that you would require?

How do you find out how to travel from Vancouver to the ski resort? Is this information important to know before you go? How would you

normally figure out these details?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

Page 8: Test script

Test Script - Tourism BC Round 2

8Tourism BC Australian Site (TB5001) April 2023

You want to research what the accommodation options for Vancouver and whistler? How would you find out about suitable accommodation for yourself and your companions?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

Is this information what they would expect to find?

Is there any additional information that they would require?

So you’ve decided that BC is the place for your next ski holiday. How do you go about booking using this website?

Would you use this website to book accommodation? If not, why not? How would you normally book accommodation on overseas ski holidays?

How do you feel about Canadian or Australian travel companies advertising on this website?

Would you use this website to purchase other travel products if they were available, such as resort ski passes?

General Debrief Questions: What are your impressions of the website?

How did you find using the site to complete the tasks we set?

What do you think about British Columbia?

Do you trust the information provided on this site? Why?

How can you tell who owns the website? Would you normally look for this information?

Would you use this site in the future, if so….what for, if not…why not?

Are there any ways that we could improve the site to meet your needs?

Page 9: Test script

Test Script - Tourism BC Round 2

9Tourism BC Australian Site (TB5001) April 2023

The following questions will be directed to segment type: Older “once in a lifetime” travellers

Say that your want to research for a big trip next year overseas somewhere. You’ve heard good things about Canada from your friends and you want to find out more about what activities and places are there to do and see that interests you. How do you start to find the information you want using the internet?

What search engine do they use?

What search terms do they input into the search engine?

What makes them click on a particular link in search results?

What information are they looking for? What are they interested in?

You’ve heard from friends that the Tourism British Columbia website is a great resource for BC travel information, how do you find the Tourism British Columbia website?

What techniques do they use to find the website?

What search terms do they input into the search engine?

Ask the participant to select the prototype from the bookmarks link:

What are your first impressions of this page?

How do you find out if British Columbia is a place you would like to visit?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Is this information what you would expect to find?

Is there any additional information that you would require

What time of year would you most like to visit?

How do they find the answer to this question?

What links do they click on?

Is this information what you would expect to find?

How do you find out if you need a visa to holiday in British Columbia?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Is this information what you would expect to find?

Is there any additional information that you would require

Page 10: Test script

Test Script - Tourism BC Round 2

10Tourism BC Australian Site (TB5001) April 2023

What clothes would you need to bring if travelling to Northern BC in winter?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Imagine that this will be your first trip to this part of the world and you’re concerned that you may not be as fully aware of the different hazards of travelling in Canada then you are back home in Australia. How do you find out about keeping safe whilst travelling around British Columbia?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Find out what airport you would fly into if visit BC from Australia? Do the participants complete the tasks easily without prompting? If

not, what are the main stumbling blocks? How do they complete the task?

As your flying into Vancouver, you decide to spend a weekend there before heading off to other parts of Canada. Find a list of things to do in Vancouver?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

Is this information what you would expect to find?

What activities are appealing?

Is this information important to know before you go? How would you normally figure out these details?

How would you find out how where to go next and how to get there?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

What travel options do they choose?

Is there any additional information that you would require?

You’ve heard that there are some fantastic cruises on the Inside Passage – how do you use the website to find information on them?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

Is there any additional information that you would require?

Page 11: Test script

Test Script - Tourism BC Round 2

11Tourism BC Australian Site (TB5001) April 2023

You want to research what the accommodation options are available in your places of interest? How would you find out about suitable accommodation for yourself and your companions?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

Is this information what they would expect to find?

Is there any additional information that they would require?

So you’ve decided that BC is the place for your next holiday. How do you go about booking using this website?

Would you use this website to book accommodation? If not, why not? How would you normally book accommodation on overseas holidays?

How do you feel about Canadian or Australian travel companies advertising on this website?

Would you use this website to purchase other travel products if they were available, such as Cruise tickets?

General Debrief Questions: What are your impressions of the website?

How did you find using the site to complete the tasks we set?

What do you think about British Columbia?

Do you trust the information provided on this site? Why?

How can you tell who owns the website? Would you normally look for this information?

Would you use this site in the future, if so….what for, if not…why not?

Are there any ways that we could improve the site to meet your needs?

The following questions will be directed to segment type: Independent traveller looking for work opportunities overseas

Scenario 1: Say that you want to research for an extended working holiday next year overseas somewhere. You’ve heard good things about Canada from your friends and you want to find out more about what activities, place and work opportunities are available that interest you. How do you start to find the information you want using the internet?

What search engine do they use?

What search terms do they input into the search engine?

What makes them click on a particular link in search results?

What information are they looking for? What are they interested in?

Page 12: Test script

Test Script - Tourism BC Round 2

12Tourism BC Australian Site (TB5001) April 2023

Scenario 2: You’ve heard from friends that the Tourism British Columbia website is a great resource for BC travel information, how do you find the Tourism British Columbia website?

What techniques do they use to find the website

Ask the participant to select the prototype from the bookmarks link:

What are your first impressions of this page?

How do you find out if British Columbia is a place you would like to visit?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Is this information what you would expect to find?

Is there any additional information that you would require

What time of year would you most like to visit?

How do they find the answer to this question?

What links do they click on?

Is this information what you would expect to find?

How do you find out if you need a visa to holiday in British Columbia?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Is this information what you would expect to find?

Is there any additional information that you would require

What clothes would you need to bring if travelling to Northern BC in winter?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Imagine that this will be your first trip to this part of the world and you’re concerned that you may not be as fully aware of the different hazards of travelling in Canada then you are back home in Australia. How do you find out about keeping safe whilst travelling around British Columbia?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

What links do they click on?

Page 13: Test script

Test Script - Tourism BC Round 2

13Tourism BC Australian Site (TB5001) April 2023

Find out what airport you would fly into if visit BC from Australia? Do the participants complete the tasks easily without prompting? If

not, what are the main stumbling blocks? How do they complete the task?

As your flying into Vancouver, you decide to spend a weekend there before heading off to other parts of Canada. Find a list of things to do in Vancouver?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

Is this information what you would expect to find?

What activities are appealing?

Is this information important to know before you go? How would you normally figure out these details?

How would you find out how where to go next and how to get there?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

What travel options do they choose?

Is there any additional information that you would require?

You’ve heard that there are some fantastic hiking in the mountains– how do you use the website to find information on this activity?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks? How do they complete the task?

Is there any additional information that you would require?

You want to research what budget accommodation options are available in your places of interest? How would you find out about suitable accommodation?

Do the participants complete the tasks easily without prompting? If not, what are the main stumbling blocks?

Is this information what they would expect to find?

Is there any additional information that they would require?

So you’ve decided that BC is the place for your next holiday. How do you go about booking using this website?

Would you use this website to book accommodation? If not, why not? How would you normally book accommodation on overseas holidays?

Page 14: Test script

Test Script - Tourism BC Round 2

14Tourism BC Australian Site (TB5001) April 2023

How do you feel about Canadian or Australian travel companies advertising on this website?

Would you use this website to purchase other travel products if they were available, such as Cruise tickets?

General Debrief Questions: What are your impressions of the website?

How did you find using the site to complete the tasks we set?

What do you think about British Columbia?

Do you trust the information provided on this site? Why?

How can you tell who owns the website? Would you normally look for this information?

Would you use this site in the future, if so….what for, if not…why not?

Are there any ways that we could improve the site to meet your needs?

Step 4: Thank-you and incentive hand over (5 mins)People will be given their incentive payments, asked to sign the “incentive received” form and thanked for their time.

- Close –