Gamification-supported Exploration of Natural User Interfaces

Technische Universität München Distributed Multimodal Information Processing Group

Stefan Diewald1, Andreas Möller1, Luis Roalter1, Matthias Kranz2

1Technische Universität München, Germany 2Luleå University of Technology, Department of Computer Science,

Electrical and Space Engineering, Luleå, Sweden

October 17, 2012 2nd Workshop on Automotive Natural User Interfaces (AutoNUI) at the 4th International Conference on

Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI), Portsmouth, NH, USA

Starting Situation: Complex Automotive User Interfaces

17.10.2012 Stefan Diewald 2

Image sources: Wikimedia Commons; http://www.e31.net/pics/Bordcomputer.jpg; http://www.auto123.com/ArtImages/102556/BMW_I_drive_i2.jpg;

Finding a desired functionality can be very time and attention-consuming.

Countermeasure: Natural User Interfaces

Image sources: http://www.autoguru.at/wp-content/uploads/2012/03/audi_multitouch_11.jpg; http://www.bmw.com/com/en/insights/technology/technology_guide/articles/_shared/img/voice_control_system.jpg

Natural User Interfaces: §  Multi-touch §  Gestures §  Voice dialogs §  … Less distraction and better user experience?

“Natural user interfaces are not natural”

“Speech utterances will have to be learned and gestures carefully developed and standardized through time.”

“None of these systems is inherently more natural than the others.”

Donald A. Norman. 2010. Natural user interfaces are not natural. interactions 17, 3 (May 2010), 6-10.

DriveAssist – Driver Assistance and Awareness System

§  Runs on mobile devices (Android smartphones and tablet PCs) §  Multi-touch for interacting with the map view

DriveAssist – Driver Assistance and Awareness System

Interaction problems with DriveAssist

First test: §  difficulties in exploring touch menus §  unaware of gestures: e.g. “pinch-to-zoom” & rotation

“Did you know?”-hints for DriveAssist

12 participants

45 minutes

only 7 did notice the hint

and only 1 found the hint useful

The Challenge

Create a strong motivation for exploring natural user interfaces in the automotive domain:

§  Uncover hidden functions

§  Make usage more comfortable

The Idea: 1 - Gamification

… the use of game design elements in non-game contexts.

Sebastian Deterding et al. 2011. From game design elements to gamefulness: defining "gamification". In Proceedings of the 15th International Academic MindTrek Conference. ACM, New York, NY, USA, 9-15.

Gamification Example

Image sources: http://aboutfoursquare.com/wp-content/uploads/2011/03/photo-11.png; http://cdn3.techworld.com/cmsdata/reviews/3210966/foursquare_badges_360.jpg;

The Idea: 2 - Share and Compare

Image sources: http://www.uplaude.com/blog/; Wikimedia Commons; Nike+

Gamification in the Automotive Domain

MyFord – collect badges online. Chevy Volt – dashboard gamification for efficient driving.

Gamification-supported Exploration of NUIs

One-time badges For more common functions.

Experience Levels For less known and less

accessed functions.

What can be gained?

Open the windows through voice control.

Enter a navigation target via handwriting recognition.

Change the chassis configuration via voice control.

When to award a Badge or Level-up?

How to award a Badge or Level-up?

Congratulations, you have just unlocked the “navigation target badge” by entering your destination via voice control.

“Share and Compare”

Image sources: http://2.bp.blogspot.com/-77IL5MZo1mQ/UDIpMenIf2I/AAAAAAAAPLg/szq3N3Iyj1Y/s1600/Tank.jpg

Share new badges and experience level-ups directly with friends in real time.

The Goal

Create a strong motivation for exploring natural user interfaces in the automotive domain,

… that is at least maintained until the user is used to the system.

Future Work

Thank you for your attention! Questions?

? ? Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 21

stefan.diewald@tum.de www.vmi.ei.tum.de/team/stefan-diewald.html

Paper Reference

•  Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/GamificationNUI_preprint.pdf

•  Please cite this work as follows: •  Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.

Gamification-supported Exploration of Natural User Interfaces In: Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI2012), pp. 47-48, Portsmouth NH, USA, October 2012

Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 22

If you use BibTex, please use the following entry to cite this work:

Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 23

@INPROCEEDINGS{NUIGamification2012, author = {Stefan Diewald and Andreas M\"{o}ller and Luis Roalter and Matthias Kranz}, title = {{Gamification-supported Exploration of Natural User Interfaces}}, booktitle = {{Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2012)}}, year = {2012}, month = oct, pages = {47--48}, location = {Portsmouth NH, USA}, }

Gamification-supported Exploration of Natural User Interfaces

Automotive

Transcript of Gamification-supported Exploration of Natural User Interfaces

Sensor Technology, Gamification, Haptic Interfaces In An ... · • Gamification. Red Dress. Red Dress Simple proximity trigger-recognition of objects and people when they come into

15. Interfaces Module V1.0 PASorigins.sese.asu.edu/ses405/Class Notes/Interfaces_Module_V1.0_PAS.pdfJun 11, 2008 · Exploration Systems Engineering: Interfaces Module 9 The Most

Designing Leaderboards for Gamification: Perceived ...library.usc.edu.ph/ACM/CHI 2017/1proc/p1949.pdf · H.5.m. Information interfaces and presentation (e.g., HCI): Miscellaneous.

Learning by Doing with Shareable Interfaces · shareable interfaces is to support learning through exploration and creation. We present our work on DigiTile as a case study of how

Leveling Up Gamification: Technologies & Strategies for More Effective Gamification … · 2019-08-01 · LEVELING UP GAMIFICATION: TECHNOLOGIES & STRATEGIES FOR MORE EFFECTIVE GAMIFICATION

RippleTouch: Initial Exploration of a Wave Resonant Based ... · H.5.2 Information Interfaces and Presentation: User Inter-faces: Haptic I/O INTRODUCTION Haptic interfaces plays an

Gamification Using a Choose-Your-Own-Adventure …...toward gamification grows, instructors need examples and options of empirically tested, successful gamification methods. Some gamification

TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data ... · TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data Exploration on Tablet Devices Jaemin Jo 1 Sehi L’Yi 1

Gamification AMER - What sensory research can learn from ... · 1) Malinoff, B. Puleston, J. (2011) How far is too far: Traditional, flash and gamification interfaces, and implications

Gamification .

GAMES AND GAMIFICATION - Center for Advanced Hindsight...SOFT GAMIFICATION VERSUS HARD GAMIFICATION. Note that this definition does not say that gamification is the transformation

Gamification - inspiração no curso de Gamification de Kevin Werbach

Chapter 1 Gamifi-wha? Introducing Gamification COPYRIGHTED ... · Gamification In This Chapter Defining gamification and seeing what it does Answering the question: Does gamification

Gamification: Psychology Inside (Gamification World Congress 2014)

Chapter 6 Further Exploration of Graphene/Semiconductor ...thesis.library.caltech.edu/9603/42/Pt12_Chapter 6_Further Work_v3.pdf · Further Exploration of Graphene/Semiconductor Interfaces

Design Space Exploration of Optical Interfaces for Silicon ...

Multi-Touch Interfaces for Public Exploration and ...1147162/FULLTEXT01.pdf · LiU-ITN-TEK-A--17/043--SE Multi-Touch Interfaces for Public Exploration and Navigation in Astronomical

Gamification & Stickers

Towards User Profile-based Interfaces for Exploration of Large ...ceur-ws.org/Vol-1050/paper2.pdf · Towards User Profile-based Interfaces for Exploration of Large Collections of

Research Exploration of Tangible User Interfaces