Service-interaction descriptions

Augmenting services with user interface models

Jo Vermeulen

Expertise Centre for Digital MediaAffiliated with the Institute for BroadBand Technology

Hasselt University - transnationale Universiteit LimburgBelgium

Lille, March 27, 2007

A better way of interacting with

services

Problem situation

Smart city environment

User interface development cannot be done manually

heterogeneous environment

dynamic nature

Semantic Web Services +Model-Based User Interface Development

1

Semantic network on top of UIML

2

3Hierarchical and reusable layout model

Architecture

Architecture

Architecture

Architecture

Architecture

Architecture

Architecture

Service-interaction descriptions

Service-interaction description

Semantic Web Services

Model-Based User Interface Development

Service-interaction description

OWL-S services

Model-Based User Interface Development

Service-interaction description

OWL-S services

Model-Based User Interface Development

Task model

>>

>>

[]>>>>

Service

Service component

Output

Input

Data type

Data type

Data type

Service-interaction description

OWL-S services

Task model and related models

Service-interaction description

OWL-S services

Task model and related models

allows both machines and humans to interact with a service

Tasks and concepts

Abstract User Interface

Concrete User Interface

Final User Interface

4 abstraction levels

Tasks and concepts

Abstract User Interface

Concrete User Interface

Final User Interface

4 abstraction levels

Tasks and concepts

Abstract User Interface

Concrete User Interface

Final User Interface

4 abstraction levels

UIML

Tasks and concepts

Abstract User Interface

Concrete User Interface

Final User Interface

4 abstraction levels

Final User Interface

Concrete User InterfaceUIML

Tasks and concepts

Abstract User Interface

1 annotate the leaf tasks• AIO• service component

extract the dialog model

set of ETS

... ...

2

Abstract User Interface

Concrete User Interface

Annotated dialog model

service component

AIO

UIML

semantic network

Interactive capabilities

Semantic network

CIO

RDF UIML vocabulary

AIO

Data type

Textfield

Input

FIO String

widget selection

service componentAIO AIO

CIO

data type

data type

There is still something missing ...

Abstract User Interface

CIO

CIO

CIOCIO

CIO

CIO CIO

What we have now

Layout model

template instance

Use case

Photo sharing service

view selected picture

view picture view rating

rate picture

enter rating submit rating

III III

[>

view selected picture

view picture view rating

rate picture

enter rating submit rating

III III

[>

1 collecting the required servicesview selected picture

view picture view rating

rate picture

enter rating submit rating

III III

[>

1 collecting the required services

View picturePictureID

View picture rating

PictureID

Submit picture rating

PictureID

Rating

Image

Rating

2 creating an annotated task model

view selected picture

view picture view rating

rate picture

enter rating submit rating

III III

[>Rating

Output Output

Image

Rating

Input Action

Submit picture rating

3 creating a layout template

3 creating a layout template

4 instantiating the layout template

4 instantiating the layout template

O

I

A

ImageO

Rating

Rating

Rate

O

O

String

String

5 the resulting user interface

5 the resulting user interface

Windows Mobile Java CDC

Conclusions

Semantic Web Services +Model-Based User Interface Development

Semantic network on top of UIML

Hierarchical and reusable layout model

allow both machines and humans to flexibly interact with a service

Backup slides