Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of...

18
Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science

Transcript of Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of...

Page 1: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

Semi-Automatic Generation of Device-Adapted User Interfaces

Stina NylanderSwedish Institute of Computer Science

Page 2: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Introduction

• Devices are different• Various services and situations

call for different devices• Services need to present

different user interfaces• How to create tailored user

interfaces without multiplying development work?

Page 3: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

System Requirements

• Abstractions that designers can use to create a device independent design

• Means to exploit the different capabilities of devices

• Means to control the presentation of the user interface

Page 4: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

What has been done

Page 5: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

The Ubiquitous Interactor

Service Interaction Engine

User Interface

Interaction Acts

Customization Form

Page 6: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

ServiceInteraction

EngineUser

InterfaceInteraction Acts

Customization Form

Interaction Acts

• Input, output, select, modify, create, destroy, start, and stop

• Contain no presentation information

• Device independent• XML encoded

<output> <id>a23</id> <name>logo</name> <life>persistent</life> <modal>false</modal> <string>SICS AB</string></output>

Page 7: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

ServiceInteraction

EngineUser

InterfaceInteraction Acts

Customization Form

Customization Forms

• Contains optional service and device specific presentation information

• Can be developed separately from services

• New customization forms do not generate changes in the service logic

Page 8: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

ServiceInteraction

EngineUser

InterfaceInteraction Acts

Customization Form

Interaction Engines

• Interpret interaction acts and customization forms

• Generate user interfaces• Device specific

Page 9: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Three levels

device specific service specific

device specificservice independent

device independent

Service

interactionacts

Interaction engine

Customizationform

Userinterface

Page 10: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Calendar Service

<select> <id>s1</id> <name>select1</name> <life>persistent</life> <modal>false</modal> <response-no>1</response-no> <string>Operations</string> <alternative> <id>a1</id> <name>alt1</name> <string>Back</string> <ret-val>back</ret-val> </alternative> . . .</select>

Page 11: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Stock Broker Service

<output> <id>tb1</id> <name>activity</name> <life>persistent</life> <modal>false<modal> <string>3</string></output>

Page 12: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Stock Broker forts.

Page 13: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

What I want to do

Page 14: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

End-User Studies

• How do users percieve the

concept of services with

multiple user interfaces

• How do users handle device

adapted user interfaces

Page 15: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Pilot study of multiple user interfaces

• Paper prototyping worked fine, but

better instructions are needed

• Context and scenarios would help

• Users need help to think of different

GUIs

Page 16: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Device adapted UIs

• Comparison with no adaptation (web

pages, remote desktop) and separate

design

• Possible parameters

– Understanding

– Preferences

– Performance

Page 17: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Summary

• I have technology for developing services with multiple user interfaces

• Now I want to take it to end-users– Concept– User interfaces

Page 18: Semi-Automatic Generation of Device-Adapted User Interfaces Stina Nylander Swedish Institute of Computer Science.

SWEDISH INSTITUTE OF COMPUTER SCIENCE

Contact Information

Stina Nylander

[email protected] www.sics.se