7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
1/19
Create a Rich Internet Application
Les 6 Reporting
Informatica Communicatie Academie
Hogeschool Arnhem Nijmegen
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
2/19
Contents of this lesson
Analysing data
Reporting
Assignment
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
3/19
Framework usability testing
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
4/19
Analysing quantitative data.Where are the problems
Analysing qualitative dataWhere are the problems
What causes these problems?Observations, questionnaires, .
What is the dimension (size) and severity of theproblems
Give suggestions for improvement
Analysing data
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
5/19
Example: Find Colleagues....
Analysing data
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
6/19
Example: Find Colleagues....
Analysing data
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
7/19
Analysing data
Scenario: Invite collegue Linked-In
User-01 User-02 User-03 User-04 User-05
Wrong clicking 2 1 0 2 3
Questions asked 2 2 0 1 4
Time needed to compl 30 20 15 20 40
0
5
10
15
20
25
30
35
40
45
User-01 User-02 User-03 User-04 User-05
Wrong clicking
Questions asked
Time needed to complete task
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
8/19
0
5
10
15
20
25
30
35
40
45
Userr-01 User-02 User-03 User-04 User-05
Wrong clicking
Questions asked
Time needed to complete task
Conclusion:
1. Four testers needed support2. Four testers needed asking questions to complete the tasks (invite a colleague)3. Testers were making mistakes (wrong clicking) when completing the tasksRecommendations:1. Put this function on start page2. Give online support in using this function
Conclusion and recommendations
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
9/19
Analysing data
Task Name Totally agree Agree Do not know Do not agree Totally disagree
1 Renting a Bike
1.1 Bike are easy to select 3 2 3 2 01.2 Pimping the bike makes fun 2 5 3 0 0
1.3 Suggested Bike type conforms to my profile 0 1 6 1 2
1.4 Accesoires are easy to select 1 4 5 0 0
0
1
2
3
4
5
6
7
Totally agree Agree Do not know Do not agree Totally disagree
Suggested Bike type conforms to my profile
Antwoord
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
10/19
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
11/19
Analyseren kwantitatieve gegevensWhat are the Metrics we want to use?
1. In relationship to the test goals;2. Depend on the selected scenarios;3. Focus on usabilityand functionality;Note: What is right or wrong (the standards you apply to)
Follow these steps (mandatory):
1. Process the data in Excel;
2. Make graphs in Excel;3. Draw conclusions from the data and graphs in Excel;4. Write suggestions for improvements.
Summary
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
12/19
Analyseren kwantitatieve gegevens
How to work?
Scenario Rent a BikeWhich scenarios
do we want to
use?
Rent a Bike
Scenarios
Testgoals
1. Right bike with the right person
2. Easy to select(a) en fun to pimp(b)
3. Accesoires are easy to select and usefull
for my tour
Decision about
the metrics1. Qualitative ordinale scale ranging from:
Totally agree, Agree, Dont know,Disaggree and totally disagree.
Posttask questions about Profile and
Recommended bike.
2. (a) Measurement of time, clicks and
needed guidance.
(b) Qualitative ordinale scale ranging
from: Totally agree, Agree, Dont
know, Disaggree and totally disagree
Posttask questions about pimping
the bike.
3. Etc.
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
13/19
Data collection
Identifier Description Observations Suggestion4.1 Bikes are easy to select 1. Difficulty with finding the right button for
selection;
Give button a colour.
2. Carousel of presenting bikes ends
abruptly and are confusing
3. Not possible to change selected bike in
the same screen
4. 3D picture of bike makes fun!
5. Money presentation is not clear to the
user
6. Next and Previous buttons are not visible
4.2 Pimping the bike makes fun ETC.
Scenario: 4. Renting a Bike
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
14/19
Analysing data
Dimension and severity of the problems
Global Local
Moderate (4.1 3) Change selected bike
new navigation needed
additional functionality
rework on design and
program
(4.1 1) Finding right button
(4.1. 2) Carousel end abrupt
easy to repair in one form
Severe (4.1. 6) Next and previous
buttons
due to MySql implementation
new version of MySql in
relationship to style sheets
used
(4.1 5) Help function is not
working
technical problem
change help library
Example how to classify problems:
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
15/19
Give advise how to solve problems
Determine priority
Problem Recommendation
1e priority 4.1 1 Finding right button Easy to repair and is needed for earning
money
Reconsider colours for accepting an offer
Reconsider shapes of buttons
4.1. 2 Carousel end abrupt Easy to repair and is needed for earning
money
Important to give user a sense of
understanding
related to his profile.
4.1. 6 Next and previous buttons Switch to latest versions of MySql, PHP
and Unix
Dont allow Ascii character set (use UTF)
Reconsider classes in style sheet
2e priority (4.1 5) Help function is not working system is rather self explaining
reconsider help text
reconsider interactive help
4.1. 3 Change selected bike Reconsider functionality Renting a bike
Add, delete, modify in one screen (also for
bookings etc.)
Example of priority classification
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
16/19
Usability Report
Will be one report!
Contains test design, conducting the test, analysingresults, drawing conclusions and writingrecommendations for improvements.
Conforms to the guidelines of reporting
Contents
Introduction
Approach and covered chapters
SEE THE EXAMPLE STRUCTURE REPORT !!!
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
17/19
Usability Report
A good Usability Report:
1. A chapter does not start with a table, graph orsummary.
2. The measurements are presented in the appendices.
3. Measurements are presented and analysed in Excel.
4. Supported graphs are presented in the report.
5. A graph contains an explanation and a conclusion.
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
18/19
Opdracht: Usability test & rapport
Perform a usability test with approximately 5 people.
Process and analyse the results.
Write a usability report outlining the problemsencountered.
Write recommendations for (usability/functional)improvements .
Approach
7/31/2019 CRIA-Les6 Rapporterentest.pptx Engels
19/19
Hand over evidence of the usability tests:
CD-ROM containing the usability tests performed
usability test report
Approach