SEMINAR "PERSONALIZING THE USER EXPERIENCE:

TECHNIQUES AND APPLICATIONS FROM SELECTED DOMAINS

(AUTOMOTIVE, RETAIL & WEB)"

Philipp Fischer: Mercedes-Benz Research & Development North America

Andreas Nürnberger: Otto-von-Guericke-University Magdeburg

myCOMAND Automotive User Interface:

Personalized Interaction with Multimedia Content Based on Fuzzy

Preference Modeling

Akmal Qodirov

Supervised by Michael Feld

Google Wallet

Akmal Qodirov 2

Bringing it all together to create the

SingleTap experience

Overview

• Motivation

• Introduction + Video on myCOMAND

• Features of myCOMAND

• Use Case of the system

• Personalization Approach

• Related Work

• Conclusions

Akmal Qodirov 3

Introduction

Akmal Qodirov 4

Motivation

Akmal Qodirov 5

myCOMAND

• Internet-based infotainment

• Harnesses the power of the Web

• Serves it up in a way that's most beneficial to the driver

• Based on driver’s specific location and needs

Akmal Qodirov 6

Video of myCOMAND

Akmal Qodirov 7

Features of myCOMAND

• Streaming Internet Radio

• Online Media Library

• Off-board Maps

• Map Information Overlays (POI)

• VoIP Telephone

Akmal Qodirov 8

Use Case Akmal Qodirov 9

System interaction is done by turning and pressing of a knob integrated into the

center console

Navi system to display the path between current location and the destination

Use Case (continued) Akmal Qodirov 10

Google Street View and user reviews

World Radio View

Short Summary

• myCOMAND integrates all trip-related content and services to

the vehicle and adapts the requirements

• Adequate and delightful presentation of Internet-based content

• Off-board manner of hosting the content data

• Constantly updating and personalizing the content data

Akmal Qodirov 11

Personalization Approach

• Data Model for Content and Content Structuring

• User Profile and Preference Modeling

• Recommendation Engine

Akmal Qodirov 12

High Level Presentation

Akmal Qodirov 13

myCOMAND client

module

Content data: maps,

internet radio streams,

user media library, etc.

Data Model for Content and Content Structuring

Akmal Qodirov 14

• Matching process is done by methods for

multimedia information retrieval

• Client relies on meta data annotated by the

supplying web service

Visualization of the Content Structure

Mapping of content items and concepts

Akmal Qodirov 15

Fuzzy Relations

Akmal Qodirov 16

Example: a fuzzy relation “Friend” describe

the degree of friendship between two persons

(in contrast to either being friend or not being

friend in classical relation!)

Fuzzy relation generalizes classical relation

into one that allows partial membership and

describes a relationship that holds between

two or more objects.

Fuzzy relations are mapping elements of one

universe, to those of another universe,

through the Cartesian product of two

universes

Fuzzy Relations (continued)

It represents the strength of association between

elements of the two sets

Akmal Qodirov 17

R = “x is considerably larger than y”

R (X, Y)= Relation between sets X and Y

R (x, y) = membership function for the relation R (X, Y)

R (X, Y) = {R (x, y) / (x, y) \ (x, y) Є (X × Y)}

Fuzzy Preference Modeling • The matching process is done by state-of-the-art methods

for multimedia information retrieval.

• The myCOMAND client relies on meta data annotated by

the supplying service.

• The user profile stores a number of fuzzy preference

relations for any content item or concept class.

Akmal Qodirov 18

Preference Modelling and Fuzzy Ratings

Akmal Qodirov 19

Clustering algorithm

used to extract

acoustic features

Pre-annotated by

vTuner web service API

Term-frequency

used to categorize

Fuzzy Ratings for a Set of Content Items

Akmal Qodirov 20

Interaction Concept

Akmal Qodirov 21

Center Console Integrated Knob

Adaptive Content Layout and Interactive Grouping

Related Work

Akmal Qodirov 22

Conslusions and Future Work • Fuzzy preference model and recommendation approach

• Comprehencive interaction (GUI)

• No feedback from users available (no user study)

• Alternative input methods

Akmal Qodirov 23

References • Pic 1: http://businesstravelalmanac.com/wp-content/uploads/2010/08/business-travel.jpg

• GPS typing: http://us.123rf.com/400wm/400/400/diego_cervo/diego_cervo0910/diego_cervo091000006/5626326-rear-view-of-woman-typing-on-gps-selective-focus.jpg

• car radio: http://images.thetruthaboutcars.com/2012/03/car_radio.jpg

• texting and driving: http://blogs-images.forbes.com/work-in-progress/files/2012/05/texting-and-driving.jpg

• eating while driving: http://wa3.cdn.3news.co.nz/3news/AM/2012/4/18/250831/burger-car-eating-food-1200.jpg?width=460

• texting 2: http://mashable.com/wp-content/uploads/2012/04/iStock_texting-while-driving.jpg

• tweet: http://buzzom.com/wp-content/uploads/2009/09/Texting-and-Driving-In-the-Middle-of-a-Tweet-Don-Wright.jpg

• www.google.com/wallet

• http://www.hmi-tec.com/pressemitteilungen_de_reader/items/hmi-praesentiert-smart-web-analyst-auf-basis-kuenstlicher-intelligenz.html

• myCOMAND UI: http://www.emercedesbenz.com/Images/Nov08/20_Mercedes_Benz_myCOMAND_Infotainment_System/683035_1230795_800_480_08C1170_001.jpg

• myCOMAND UI2: http://images.thecarconnection.com/med/mercedes-benz-mycomand-next-generation-vehicle-infotainment-system_100189022_m.jpg

• myCOMAND UI3: http://74.220.219.73/~emercede/magazine/wp-content/uploads/command-635x360.jpg

• myCOMAND UI4: http://media.emercedesbenz.com/magazine/wp-content/uploads/683061_1230847_5051_3788_08C1169_003.jpg

• server: http://www.dtssyr.com/images/server-opt.jpg

• user: http://www.veryicon.com/icon/png/System/Free%20Business/User.png

• music icon: http://pivotslager1.webs.com/Music-icon.png

• internet radio: http://appyourmac.com/wp-content/uploads/2009/04/aol-radio-icon1.png

• news: http://www.psdgraphics.com/wp-content/uploads/2009/12/web-news-icon.jpg

• voronka: http://www.euro-pressol.ru/_dr/1/96425.gif

• info: http://www.psdgraphics.com/wp-content/uploads/2009/04/info-icon.jpg

• knob1: http://i.ytimg.com/vi/vQL0tqLCjcQ/0.jpg

• http://osp.mans.edu.eg/elbeltagi/AI%20FuzzyRelations.pdf

• http://www.intelligent-systems.info/classes/ee509/6.pdf

Akmal Qodirov 24