Service-interaction descriptions: augmenting services with user interface models
56
Service-interaction descriptions Augmenting services with user interface models Jo Vermeulen Expertise Centre for Digital Media Affiliated with the Institute for BroadBand Technology Hasselt University - transnationale Universiteit Limburg Belgium Lille, March 27, 2007
-
Upload
jo-vermeulen -
Category
Business
-
view
2.439 -
download
0
description
Semantic service descriptions have paved the way for flexible interaction with services in a mobile computing environment. Services can be automatically discovered, invoked and even composed. On the contrary, the user interfaces for interacting with these services are often still designed by hand. This approach poses a serious threat to the overall flexibility of the system. To make the user interface design process scale, it should be automated as much as possible. We propose to augment service descriptions with high-level user interface models to support automatic user interface adaptation. Our method builds upon OWL-S, an ontology for Semantic Web Services, by connecting a collection of OWL-S services to a hierarchical task structure and selected presentation information. This allows end-users to interact with services on a variety of platforms. Presented as a shorter version of my EIS 2007 talk at Laboratoire d'Informatique Fondamentale de Lille (LIFL) in Lille on March 27th, 2008.
Transcript of Service-interaction descriptions: augmenting services with user interface models
Service-interaction descriptions
Augmenting services with user interface models
Jo Vermeulen
Expertise Centre for Digital MediaAffiliated with the Institute for BroadBand Technology
Hasselt University - transnationale Universiteit LimburgBelgium
Lille, March 27, 2007
A better way of interacting with
services
Problem situation
Smart city environment
User interface development cannot be done manually
heterogeneous environment
dynamic nature
Semantic Web Services +Model-Based User Interface Development
1
Semantic network on top of UIML
2
3Hierarchical and reusable layout model
Architecture
Architecture
Architecture
Architecture
Architecture
Architecture
Architecture
Service-interaction descriptions
Service-interaction description
Semantic Web Services
Model-Based User Interface Development
Service-interaction description
OWL-S services
Model-Based User Interface Development
Service-interaction description
OWL-S services
Model-Based User Interface Development
Task model
>>
>>
[]>>>>
Service
Service component
Output
Input
Data type
Data type
Data type
Service-interaction description
OWL-S services
Task model and related models
Service-interaction description
OWL-S services
Task model and related models
allows both machines and humans to interact with a service
Tasks and concepts
Abstract User Interface
Concrete User Interface
Final User Interface
4 abstraction levels
Tasks and concepts
Abstract User Interface
Concrete User Interface
Final User Interface
4 abstraction levels
Tasks and concepts
Abstract User Interface
Concrete User Interface
Final User Interface
4 abstraction levels
UIML
Tasks and concepts
Abstract User Interface
Concrete User Interface
Final User Interface
4 abstraction levels
Final User Interface
Concrete User InterfaceUIML
Tasks and concepts
Abstract User Interface
1 annotate the leaf tasks• AIO• service component
extract the dialog model
set of ETS
... ...
2
Abstract User Interface
Concrete User Interface
Annotated dialog model
service component
AIO
UIML
semantic network
Interactive capabilities
Semantic network
CIO
RDF UIML vocabulary
AIO
Data type
Textfield
Input
FIO String
widget selection
service componentAIO AIO
CIO
data type
data type
There is still something missing ...
Abstract User Interface
CIO
CIO
CIOCIO
CIO
CIO CIO
What we have now
Layout model
template instance
Use case
Photo sharing service
view selected picture
view picture view rating
rate picture
enter rating submit rating
III III
[>
view selected picture
view picture view rating
rate picture
enter rating submit rating
III III
[>
1 collecting the required servicesview selected picture
view picture view rating
rate picture
enter rating submit rating
III III
[>
1 collecting the required services
View picturePictureID
View picture rating
PictureID
Submit picture rating
PictureID
Rating
Image
Rating
2 creating an annotated task model
view selected picture
view picture view rating
rate picture
enter rating submit rating
III III
[>Rating
Output Output
Image
Rating
Input Action
Submit picture rating
3 creating a layout template
3 creating a layout template
4 instantiating the layout template
4 instantiating the layout template
O
I
A
ImageO
Rating
Rating
Rate
O
O
String
String
5 the resulting user interface
5 the resulting user interface
Windows Mobile Java CDC
Conclusions
Semantic Web Services +Model-Based User Interface Development
Semantic network on top of UIML
Hierarchical and reusable layout model
allow both machines and humans to flexibly interact with a service
Backup slides
