Centro de Investigación en Tecnologías de la Información y las Comunicaciones www.citic-research.org

Usability LIDIA Research Group

A Coruña, Spain

Usability – Research

Theoretical

Research

Applied Research

3

Usability - Projects

4

Projects

European Galileo Speed Warning (GSW). Grant Agreement No 228357 7th Framework Programme. European GNSS Supervisory Authority

(GSA). 299.392,00 €. 2009-2010

Spanish Goverment

Design, development, implementatios and test of a tool for the validation and usability analysis of intelligent systems. Ministerio de

Ciencia y Tecnología. 120.424,79 €. 2001-2004

Integration of heurístic, empiric and subjective methods for the developmento of a tool for the usability analysis of computerized

systems. CICyT-MEC. 75.000,00 €. 2005-2008

Regional Goverment

Development of methodologies, techniques, and tools for the usability analysis and accessibility of web sites and web applications.

Proyecto sectorial Xunta de Galicia. 82.800,00 €. 2008-2011

Contracts w. companies

PROSAICO and PROSAICO-Salud: A decision support system for the prescription and supervision of physical activity oriented to health and sports improvement. Supera Gestión. 85.420,00 €. 2006-2009

and 107.582,50 €. 2009-2012

Intelligent Tools for the analysis of users behaviour in the access and comsuption of digital content in multi-platforms. PRISA Digital S.L..

143.900,00 €. 2011-2014

Theoretical Research

5

ISO 9241-11:

“THE EXTENT TO WHICH A PRODUCT CAN BE USED BY SPECIFIED USERS TO ACHIEVE SPECIFIED GOALS WITH EFFECTIVENESS, EFFICIENCY AND SATISFACTION IN A SPECIFIED CONTEXT OF USE”

Theoretical Research

Development of a usability taxonomy

6

Usability

Knowability Operativity Efficiency Robustness Safety Subjective satisfaction

Property by means of which the

user can understand, learn, and

remember how to use the system

Capacity of the system to produce

appropriate results in return for the

resources that are invested

Capacity of the system to provide

users with the necessary functionalities and

to permit users with different needs to

adapt and use the system.

Theoretical Research

Usability criteria is further divide in sub-attributes

7

Clarity Consistency Memorability Helpfulness

Knowability

Elements

Structure

Funcitioning

Usability

Elements

Structure

Funcitioning

Elements

Estructura

Funcitioning

Documentation

Interactivity

Ease with which the system

can be perceived by the

mind and the senses

Property of the system that

enables the user to remember

the elements and the

functionality of the system

Theoretical Research

Context of use taxonomy

8

Rol Experience Education …

User

Context of Use

Complexity Demands Safety …

Task

Physical

Social Technical

Environment

Theoretical Research

Applications taxonomy

9

Speciality Function

Type

Software

Requirements Context Company

Domain

Administration

Engineering

…

System

Application

Development

Theoretical Research

Use of the taxonomies

10

Usability Taxonomy

Applications Taxonomy Context of use Taxonomy

Instantiated usability

taxonomy

20% 30% 50%

Techniques

Recommended

Techniques

Applied Research - Tools

Usability requirements tool

11

Applied Research - Tools

MAUT (Multi-Attribute Utility Theory) Questionnaires

12

Applied Research - Tools

MAUT (Multi-Attribute Utility Theory) Questionnaires

13

Applied Research - Tools

HTML Analyzer

14

Applied Research - Tools

Multi-agent system for web usabiliy analysis

15

Usability – Example (GSW Project)

16

EUROPEAN PROJECT Galileo Speed Warning (GSW)

PROJECT NUMBER Grant Agreement No 228357 7th Framework Programme

AGENCY European GNSS Supervisory Authority (GSA)

PARTNERS Avego Ltd., Technolution BV, Universidade da Coruña

DURATION 2009 – 2010

AMOUNT Total budget (395.387,00 €), Total grant (299.392,00 €)

MAIN RESEARCHER Coordinator: Jonathan Guard (Mapflow) Main researcher UDC: Eduardo Mosqueira Rey

Usability – Example (GSW Project)

Objective

•Development of CARAT-Counter, an Intelligent Speed Adaptation (ISA) device that gives points to drivers that obey speed limits”

•“Use the carrot, not the stick”

17

PinPoint magazine. Summer 2009

Usability – Example (GSW Project)

Usability requirements

• Attribute: “Knowability Clarity Clarity in formal elements”

• Requirement “Is the text displayed clearly?”

18

Usability – Example (GSW Project)

Heuristic analysis

• Requirement “Is the text displayed clearly?”

• Result: “Text size is small. Contrast is low”.

19

Usability – Example (GSW Project)

Heuristic Analysis

• Problem:

Contradictory messages in the interface: “good” and long face.

• Cause:

“good” doesn’t mean that the driver is driving correctly it means that the driver is earning points but is about to surpass the speed limit

• Solution:

Avoid text messages and change them by an icon

20

Texto Icono

Bad

Improving

Good

Neutral

Usability – Example (GSW Project)

Subjective questionnaires

• Collect user opinions about usability

• They are based in the usability taxonomy

21

Usability – Example (GSW Project)

Empirical analysis

• Log analysis trying to identify usability analysis

• Example: The device is too dependent of GPS signals and of the accuracy of maps

22

Publications

ISI-JCR Journals (Usability)

•Alonso-Rios D., E. Mosqueira-Rey et al. “Usability: A Critical Analysis and a Taxonomy” (2010) International Journal of Human-Computer Interaction, 26(1) 53-74. DOI: 10.1080/10447310903025552

•Alonso-Rios, D., E. Mosqueira-Rey et al. (2010) “A Context-of-Use Taxonomy for Usability Studies” International Journal of Human-Computer Interaction, 26(10) 941-970. DOI: 10.1080/10447318.2010.502099

•D. Alonso-Ríos, E. Mosqueira-Rey, and V. Moret-Bonillo "A Taxonomy-guided Approach to Usability Studies: Application to an Intelligent Speed Adaptation Device", International Journal of Human-Computer Interaction (PENDIENTE ACEPTACIÓN)

23

Publicaciones

ISI-JCR Journals (Validation)

•E. Mosqueira-Rey, V. Moret-Bonillo, A. Fernández-Leal (2008) “An Expert System to Achieve Fuzzy Interpretations of Validation Data” Expert Systems with Applications, ISSN: 0957-4174, 35 (4), pp. 2089-2106. DOI:10.1016/j.eswa.2007.09.045

•E. Mosqueira-Rey, V. Moret-Bonillo (2000) “Validation of Intelligent Systems: A Critical Study and a Tool” Expert Systems with Applications, ISSN: 0957-4174, 18 (1), pp. 1-16

24

CORE Conferences

• E. Mosqueira-Rey, D. Alonso-Ríos, V. Moret-Bonillo, “Usability Taxonomy and Context-of-Use Taxonomy for Usability Analysis”, IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC-09), San Antonio, Texas, USA, Oct. 11-14, 2009.

• D. Alonso-Ríos, I. Luis-Vázquez, E. Mosqueira-Rey, V. Moret-Bonillo. “An HTML analyzer for the study of web usability”, 2009 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC-09) , San Antonio, Texas, USA, Oct. 11-14, 2009.

• E. Mosqueira-Rey et. al. (2007) “An Evolutionary Multiagent System for Studying the Usability of Websites” 1st Int.l Work. on Int. Web Based Tools as part of the 19th IEEE Int. Conf. on Tools with Artificial Intelligence (ICTAI-07). vol. 302, pp. 34-41. Patras, Grecia. Oct. 29-31, 2007

• E. Mosqueira-Rey, J. Rivela Carballal, V. Moret-Bonillo (2004) “Integrating GOMS Models and Logging Methods into a Single Tool for Evaluating the Usability of Intelligent Systems”. IEEE SMC 2004 Int. Conf. on Systems, Man and Cybernetics. pp. 5142-5147, The Hague, The Netherlands, Oct. 10-13, 2004

25

26

Información adicional

Web Page:

http://www.lidiagroup.org

Usability Coordinator:

Eduardo Mosqueira Rey eduardo@udc.es

Facultad de Informática Campus de Elviña, s/n 15071, A Coruña (España) T 981 167 000 Ext. 1343

Contact

Centro de Investigación en Tecnologías de la Información y las Comunicaciones www.citic-research.org