Adaptive and Plastic User Interfaces: A review of the State of the Art.

Adaptive and Plastic User InterfacesA review of the state of the art

Eduardo Castillejo

DeustoTech - Deusto Institute of Technology, University of Deusto

October 19, 2012

Outline

UI Adaptation

Web UI Adaptation

Services adaptation

References

Adaptive and Plastic User Interfaces 2 / 34

Outline

UI Adaptation[Calvary 2001 I][Repo 2004][Nilsson 2006] [Hallsteinsen 2004][Lehtonen 2002][Stuerzlinger 2006][Stuerzlinger 2006]Summary

Web UI Adaptation

Services adaptation

References

Adaptive and Plastic User Interfaces UI Adaptation 3 / 34

[Calvary 2001 I]

I Based in Context migrations. Each change activates atrigger that launches the best suitable interface selectionprocess.


[Calvary 2001 I]


[Repo 2004]

I Based on a middleware which manages the adaptationprocess.

I The platform detects the user’s device (1), queries itscapabilities (3), and returns the corresponding user interfacetaking into account the selected service and the currentdevice (4).


[Nilsson 2006] [Hallsteinsen 2004]

I The applications are built to support the creation of variantswhich fit with the different requisites that may appear duringits use.

I The adaptation middleware creates and manages anacceptable configuration of the applications.


[Lehtonen 2002]

I The adaptation process is based on some configurationfiles (Product Configuration Files) which define the interfaceappearance and stores the user’s parameters.

I The designed UI are based on Bean Markup Language (alanguage oriented to UI) and Java Beans.

I BML is directly runnable, so it is possible to be launched atruntime.


[Lehtonen 2002]


[Stuerzlinger 2006]

I It’s focused on the adaptation of desktop applications andthe re-configuration of the current window interfaces by aUser Interface Facades system.


[Stuerzlinger 2006]


Summary

Solution Paradigm Adaptation Dynamic process Platform

[Calvary 2001 I] Prologue-Action-Epilogue Based on context Yes Mobile[Calvary 2001 II] Prologue-Action-Epilogue Based on context Yes Mobile[Repo 2004] Middleware (*) No Mobile[Nilsson 2006] Middleware Based on context Yes Mobile

[Hallsteinsen 2004] Middleware Based on context Yes Mobile[Lehtonen 2002] Document assembly Based on user parameters Yes Mobile

[Stuerzlinger 2006] User Interface Facades Based on direct interaction No Desktop

* Although they make references to context, it is its own change which launches the adaptation process, but it is notlaunched by its current parameters or values.


Outline

UI Adaptation

Web UI Adaptation[Safi 2011][Malandrino 2010][Domingues 2011][Paterno 2010]Summary

Services adaptation

References

Adaptive and Plastic User Interfaces Web UI Adaptation 13 / 34

[Safi 2011]

I XHTML server that applies a specific CSS based sourcecode to the web page and allows the adaptation of therequested web pages to heterogeneous mobile devices.

I Some extra parameters (e.g. device OS, screen resolutionand size, available font styles...) are taken into account toenhance the adaptation process.


[Safi 2011]


[Malandrino 2010]

I Based on the same idea of [Safi 2011], adding context to theequation.


[Domingues 2011]

I The web page is modified with some dynamic andautomatic changes in the web browser.

I Problem: it is necessary to include an AJAX script to be runin the client side.

I This script requests the corresponding adaptation requestsand renders the adaptation output.


[Domingues 2011]


[Paterno 2010]

I The client request is analysed similarly to the previoussolutions by using a middle side server.

I The web page’s HTML logic and the associated CSS files areextracted by a reverse engineering process.

I Next, these files are sent to a module which main purpose isto redesign the web page for the client device.

I Some of the graphic interface elements or views aresubstituted by others which are semantically equivalent.


[Paterno 2010]


Summary

Solution Paradigm Use of context Used capabilities

[Safi 2011] Adaptation server (XHTML + CSS) - Device’s[Malandrino 2010] Adaptation server Network architecture;

User’s current activity;User’s preferences; Device’s and user’s

[Domingues 2011] Adaptation server - -[Paterno 2010] Middle side server - -


Outline

UI Adaptation

Web UI Adaptation

Services adaptation[Camara 2009][Moser 2008][Kongdenfha 2006]

References

Adaptive and Plastic User Interfaces Services adaptation 22 / 34

[Camara 2009]

I A tool (ITACA) which supports generative adaptation,starting from the already existing automatic descriptioninterface behaviour model extraction.

I It supports the specification and validation of adaptationagreements, it automatizes the protocols generation andrelates the proposed abstract model with implementationlanguages.

I Problem: The agreements specification may need humanparticipation.


[Camara 2009]


[Moser 2008]

I VieDAME, a platform based on the substitution ofsemantically equivalent elements, assuring that,intercepting SOAP messages and suffering from a very littleperformance penalty and by using a vision based on aspects,it is capable of substitute services at runtime in BPELenvironments.


[Moser 2008]

I The ”VieDAME core” includes the monitoring, serviceselection and message transformation, and it providesservices as the storage and access to data and data planningand configuration.

I ”VieDAME engine adapters”.


[Moser 2008]


[Kongdenfha 2006]

I A framework to manage the service adaptation based on AOPto interact with independent service protocols and operation.

I A taxonomy of a possible incongruence between interfaces isidentified .

I To work with this incongruences some adaptation templatesare used.


[Kongdenfha 2006]


Outline

UI Adaptation

Web UI Adaptation

Services adaptation

References

Adaptive and Plastic User Interfaces References 30 / 34

References

I [Nilsson 2006] E. G. Nilsson, J. Floch, S. Hallsteinsen, y E. Stav, “Model-based user interface adaptation”,Computers & Graphics, vol. 30, num. 5, pp. 692–701, 2006.

I [Schilit 1995] W. N. Schilit, “A system architecture for context-aware mobile computing”, Columbia University,1995.

I [Dey 2001] A. K. Dey, “Understanding and using context”, Personal and ubiquitous computing, vol. 5, num. 1, pp.4–7, 2001.

I [Calvary 2001 I] G. Calvary, J. Coutaz, y D. Thevenin, “Supporting context changes for plastic user interfaces: aprocess and a mechanism”, People and Computers, pp. 349–364, 2001.

I [Calvary 2001 II] G. Calvary, J. Coutaz, y D. Thevenin, “A unifying reference framework for the development ofplastic user interfaces”, Engineering for Human-Computer Interaction, pp. 173–192, 2001.

I [Calvary 2002] G. Calvary, J. Coutaz, D. Thevenin, Q. Limbourg, N. Souchon, L. Bouillon, M. Florins, J.Vanderdonckt, y others, “Plasticity of User Interfaces: A Revisited Reference Framework”, in In Task Models andDiagrams for User Interface Design, 2002.

I [Repo 2004] P. Repo, “Facilitating user interface adaptation to mobile devices”, in Proceedings of the third Nordicconference on Human-computer interaction, 2004, pp. 433–436.

I [Hallsteinsen 2004] S. Hallsteinsen, E. Stav, y J. Floch, “Self-adaptation for everyday systems”, in Proceedingsof the 1st ACM SIGSOFT workshop on Self-managed systems, 2004, pp. 69–74.

I [Stuerzlinger 2006] W. Stuerzlinger, O. Chapuis, D. Phillips, y N. Roussel, “User interface facades: towards fullyadaptable user interfaces”, in Proceedings of the 19th annual ACM symposium on User interface software andtechnology, 2006, pp. 309–318.

I [Marmolin 1995] H. Marmolin, Y. Sundblad, K. Schmidt, y others, “Medium versus mechanism: Supportingcollaboration through customisation”, in ECSCW’95: proceedings of the Fourth European Conference onComputer-Supported Cooperative Work, 10-14 September 1995, Stockholm, Sweden, 1995, vol. 8, p. 133.


References

I [Weerawarana 2001] S. Weerawarana, F. Curbera, M. J. Duftler, D. A. Epstein, y J. Kesselman, “Bean MarkupLanguage: A composition language for JavaBeans components”, in Proceedings of the 6th conference onUSENIX Conference on Object-Oriented Technologies and Systems-Volume 6, 2001, pp. 13–13.

I [Lehtonen 2002] M. Lehtonen, R. Petit, O. Heinonen, y G. Linden, “A dynamic user interface for documentassembly”, in Proceedings of the 2002 ACM symposium on Document engineering, 2002, pp. 134–141.

I [Watanabe 1999] T. Watanabe, “Document Analysis and Recognition”, IEICE transactions on information andsystems, 1999.

I [Gu 2006] X. D. Gu, J. Chen, W. Y. Ma, y G. L. Chen, “Visual based content understanding towards webadaptation”, in Adaptive Hypermedia and Adaptive Web-Based Systems, 2006, pp. 164–173.

I [Safi 2011] Q. G. K. Safi, T. Nawaz, S. M. A. Shah, y T. Mahmood, “Intelligent Device Independent UI Adaptionfor Heterogeneous Ubiquitous Environments”, IJCSNS, vol. 11, num. 11, p. 75, 2011. Global Mobile Statistics2012: Mobile browsing v desktop browsing.

I [Malandrino 2010] D. Malandrino, F. Mazzoni, D. SRiboni, C. Bettini, M. Colajanni, y V. Scarano, “MIMOSA:context-aware adaptation for ubiquitous web access”, Personal and Ubiquitous Computing, vol. 14, num. 4, pp.301–320, 2010.

I [Domingues 2011] M. A. Domingues, “Exploiting multidimensional data for web site automation”, AICommunications, vol. 24, num. 3, pp. 289–290, 2011.

I [Paterno 2010] F. Paterno y G. Zichittella, “Desktop-to-mobile web adaptation through customizabletwo-dimensional semantic redesign”, Human-Centred Software Engineering, pp. 79–94, 2010.

I [Camara 2009] J. Camara, J. A. Martin, G. Salaun, J. Cubo, M. Ouederni, C. Canal, y E. Pimentel, “Itaca: Anintegrated toolbox for the automatic composition and adaptation of web services”, in Software Engineering, 2009.ICSE 2009. IEEE 31st International Conference on, 2009, pp. 627–630.

I [Moser 2008] O. Moser, F. Rosenberg, y S. Dustdar, “Non-intrusive monitoring and service adaptation forWS-BPEL”, in Proceedings of the 17th international conference on World Wide Web, 2008, pp. 815–824.


References

I [Kongdenfha 2006] W. Kongdenfha, R. Saint-Paul, B. Benatallah, y F. Casati, “An aspect-oriented framework forservice adaptation”, Service-Oriented Computing–ICSOC 2006, pp. 15–26, 2006.

I [Benatallah 2005] B. Benatallah, F. Casati, D. Grigori, H. Nezhad, y F. Toumani, “Developing adapters for webservices integration”, in Advanced Information Systems Engineering, 2005, pp. 415–429.


All rights of images are reserved by theoriginal owners*, the rest of the content is licensed

under a Creative Commons by-sa 3.0 license.

* [Calvary 2001 I], [Calvary 2001 II], [Repo 2004], [Nilsson 2006],[Lehtonen 2002], [Stuerzlinger 2006], [Safi 2011], [Malandrino 2010],[Domingues 2011], [Paterno 2010], [Camara 2009], [Moser 2008],[Kongdenfha 2006]

Adaptive and Plastic User InterfacesA review of the state of the art

Eduardo Castillejo

DeustoTech - Deusto Institute of Technology, University of Deusto

October 19, 2012

Adaptive and Plastic User Interfaces: A review of the State of the Art.

Documents

Transcript of Adaptive and Plastic User Interfaces: A review of the State of the Art.