Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens
-
Upload
sirris -
Category
Technology
-
view
223 -
download
0
description
Transcript of Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens
![Page 1: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/1.jpg)
Tsiporkova Elena & Stevens Tom
2013
![Page 2: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/2.jpg)
![Page 3: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/3.jpg)
7th EU Framework Programme
Generic architecture
Proactive decision support
5 demonstrators
![Page 4: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/4.jpg)
Demonstrators
Emergency dispatching
Production management
Patterns
Document
Share
Formalize knowledge to exploit
![Page 5: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/5.jpg)
![Page 6: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/6.jpg)
Observation during field studies
Comparison of design challenges for
demonstrators during workshop
Enrichment through
information modeling workshop
Prototyping
Forces identification
Applicability analysis
![Page 7: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/7.jpg)
Multiple warnings
Meaningful sounds
Goal progression-based information detail and adaptation
![Page 8: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/8.jpg)
Mode switch
Interactive instructions
Modality combination for urgent messages
![Page 9: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/9.jpg)
Spatial point representation
Context-based information articulation
![Page 10: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/10.jpg)
![Page 11: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/11.jpg)
Generic attributes for patterns
User
Device
Environment
Task
System
Knowledge described in the form of
Attribute values, depending on context
Relationships
Rules
Interaction
Information
Event
Modality
![Page 12: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/12.jpg)
The semantic modelling and reasoning environment aims at facilitates the design of
multimodal interfaces in practice and enables the capacity to:
capture and model HMI design patterns, formal guidelines and expert domain
knowledge in the field of multimodal interface design
reason and derive design recommendations (e.g. applicable HMI patterns) during the
interface design
allow dynamic interface adaptation (e.g. context-aware output modality) at runtime
![Page 13: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/13.jpg)
The developed semantic model is a hierarchical class structure composed of a
nested set of ontological models consisting of three levels of abstraction
Core Design
Pattern Model
![Page 14: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/14.jpg)
The core model defines a set of parameters and a multitude of relationships
between them, e.g.
![Page 15: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/15.jpg)
The core model implements two types of reasoning rules:
• Chain rules: deduce a relationship based on the transitive application of two other relationships, e.g.
(System runsOn Device) AND (Device isUsedBy User) → (System interactsWith User)
• SWRL1 rules: express a common sense knowledge or logic rules applicable to any design situation, e.g.
IF (System detects Event) AND (Event hasCriticallityLevel severe) THEN (Event hasPriority high)
(1) A Semantic Web Rule Language
![Page 16: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/16.jpg)
Applicability conditions for design patterns are described via SWRL rules:
• Important Message Pattern
IF (System detects Event) AND (Event hasPriority high) AND (User hasAttention on_environment)
THEN (Interaction exhibitsPattern important_message_pattern)
• Combination of Modalities Pattern
IF (System detects Event) AND (Event impacts Environment) AND (Environment hasSafetyLevel
risk_full) AND (System sends Information) AND (Information hasType instruction) THEN
(Interaction exhibitsPattern combination_of_modalities_pattern)
![Page 17: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/17.jpg)
The purpose of this level is to
model a concrete application domain e.g. emergency dispatching
derive new knowledge from the models and data in the inner abstraction layers
The semantic models are instantiated with information such as
types of users involved: fire fighters, fire commanders;
activities and tasks: evacuation, search and rescue;
applications and devices: application features (supported users, detected events); device
type, status (active, idle), components (audio, haptic);
working environment: inside/outside, noise/security level;
events: type (toxic smoke formation, approaching dangerous goods), priority, criticality level
![Page 18: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/18.jpg)
Produce design recommendations during the interface design process
allows modelling of a concrete application situation e.g. a fire commander instructs his firefighters to evacuate the building that is on fire
enables easy simulation of different situations e.g. if approaching dangerous goods detected then send alarm message and display detailed map
derives the applicable design patterns for the concrete interaction
Dynamic interface adaptation at runtime
suggests the modality to use according to context
determines the type of message and the level of detail
selects the device where the message needs to be sent
…
![Page 19: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/19.jpg)
User
body
awareness visual output
loud
Application
Event Interaction
![Page 20: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/20.jpg)
Validate and enrich patterns
Refine and extend ontology
Implement ontology at runtime
Collaboratively enrich ontology
![Page 21: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/21.jpg)
Ferreira Nàdia
Geldof Sabine
Hristoskova Anna
Tourwé Tom
Artemis Joint Undertaking for
embedded computing
Innoviris research funding
![Page 22: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/22.jpg)
![Page 23: Astute symposium 2013-10-10_hmi_design_patterns_elenatsiporkova_tomstevens](https://reader034.fdocuments.in/reader034/viewer/2022051609/546f105caf795958298b5a91/html5/thumbnails/23.jpg)