Validating a smartphone-based pedestrian navigation system prototype - An informal eye-tracking...

© kluge&asche·ifg·uni·potsdam·2012 1 | 20

iccsa-2012

Validating a smartphone-based pedestrian navigation system prototype

An informal eye-tracking pilot test

M. Kluge & H. AscheUniversity of PotsdamGermany

ICCSA 2012, Salvador de Bahia, 19.06.2012

iccsa-2012


iccsa-2012

Structure

1. Introduction

2. Concept

3. Eye-Tracking

4. Results

5. Summary

Introduction

Summary

1

3

5

2

4

Results Eye-Tracking

Concept

Structure


iccsa-2012

Chapter 1 | Introduction

iccsa-2012


iccsa-2012

Pedestrian traffic is an integrated part of traffic Pedestrians are road users and passengers in public

transport existing navigation systems for pedestrians are based on

2D map representations or depict reality as a 3D model the majority of PNS on the market are smaller versions of

VNS Navigation problems occur if the user is unable to relate

the information of an instruction to the real environment one reason is the visualization of the navigation instruction

Pedestrian Navigation

Chapter 1| Introduction

time

siz

e

time

con

ten

tHypothesis:The use of Augmented Reality corresponds to the appearance of human perception and relates the AR instructions to prominent objects and allows the implementation in the real environment.


iccsa-2012

AR allows the user to see the image of the real world superimposed with virtual objects

AR is part of the virtual continuum of the mixed reality mixed reality combines different forms of representation AR supplements the environment with extensive

information instead of recreating or replacing it

Augmented Reality

Chapter 1| Introduction

Virtual EnvironmentAugmented Virtuality

Mixed Reality

Real Environment Augmented Reality

Source: Milgram & Kishino, 1994


iccsa-2012

Chapter 2 | Concept

iccsa-2012


iccsa-2012

the central focus is the combination of reality and virtual reality

this common view will be extended by a virtual route representation, which follows the route course in reality

the structure is as follows: the perspective adjustment and the calculation of the virtual

image scene require a data model, which remains hidden from the viewer

the prototype is the result of a virtual route that is superimposed on the front of the camera image

the instruction is displayed on the screen and perceived by the user

Conception

Chapter 2| Concept

Map Data Virtual Route

Camera Image

RealityView Screen User


iccsa-2012

the prototype has a modular construction and based on an free and open source navigation platform (http://www.navit-project.org/)

the structure of the concept consists of the three processes registration, tracking and presentation registration process: captures position and alignment from

sensors tracking process: specifies the trace of virtual objects presentation process: describes the output on the screen

Construction

Chapter 2| Concept

Graphical System Video Overlay Reality

Video Stream

Camera

VirtualRoute

User

Tracking

OrientationCompass

Acceleration

GPS

Sensor Presentation

Hardware

Display

Registration

Alignment

Envi

ronm

enta

l con

ditio

ns

Augmented Reality


iccsa-2012

RealityViewPresentation the screen can be operated in

two display-modes (AR & map) the activation or change is

done by changing the alignment of the unit

Virtual Cable a virtual route will be

positioned with respect to the real location

Concept is taken from vehicle navigation and called Virtual Cable

Features are described as “safe, simple and intuitive”

navigates a user along a route without a detailed description

Chapter 2| Concept


iccsa-2012

Chapter 3 | Eye-Tracking

iccsa-2012


iccsa-2012

Eye-Tracking TechnologyTechnology Eye-Tracking records the eye

movements and the point of gaze

is described as a non-invasive, video-based technology

the use of a mobile eye-tracker allows the recording in outdoor areas

the tracking process consists of the following steps: calibration procedure to measure

the properties of the eye measure of the pupil center locate the relative position of the

corneal reflection calculate the direction of gaze

Chapter 3| Eye-TrackingSo

urce

: htt

p://

ww

w.s

miv

isio

n.co

m/


iccsa-2012

Eye-Tracking SetupExperimental Procedure only a pilot test was performed test sessions divided in three

parts Introduction Test Run Questionnaire

Experimental Setup a user-centered eye camera

captures the point of gaze a scene camera records the

real environment both are mounted on a

headgear the recorded information is

stored by a mobile computer

Chapter 3| Eye-Tracking

Eye and scene camera

Helmet

SmartphoneComputer

Scene camera

Smartphone camera

Eye camera


iccsa-2012

the evaluation allows scientific analysis of eye movement and displays the duration of fixation in front of the video sequence

the following properties would be measured: the pattern of various fixations (scan paths) the time spent looking at display elements (growing circle) the deployment of prominent objects in the real environment

Eye-Tracking Evaluation

Chapter 3| Eye-Tracking


iccsa-2012

Chapter 4 | Results

iccsa-2012


iccsa-2012

Test Run

Chapter 4| Results


iccsa-2012

with one exception, all test subjects had an identical favorite at the individual stations most of the users tried to use the AR-mode at decision points

with more than one possibility the map display was used more often along two decision

points

all of them used prominent objects to recognize the instruction in the real environment

the most common navigation strategy of a user was to follow the virtual cable in the AR-mode, and to display the target and current location in the 2D map

conclusion: the AR display provides a detailed navigation at decision

points the map display allows a better overview

Test Run Results

Chapter 4| Results


iccsa-2012

Structure the questionnaire based on the

System Usability Scale (SUS) had an extent of ten questions the rating based on the Likert-

Scale the validation results provided a

mean score of 75 out of 100 points

a SUS score of 75 points can be interpreted as a grade of B

all test subjects rate the third statement, "I thought the system was easy to use" with value 5

in conclusion, the requirement of intuitive use has been fulfilled

Chapter 4| Results

Questionnaire

1 2 3 4 5 6 7 8 9 100

1

2

3

4

5

6

Person 1 Person 2 Person 3 question

resp

onse

75

70%


iccsa-2012

Chapter 5 | Summary

iccsa-2012


iccsa-2012

the paper described the conceptual structure of an AR-based PNS and the validation based on eye-tracking technology

the validation of the prototype confirms the hypothesis that the use of Augmented Reality for pedestrian navigation is possible and is also accepted by the user group

the evaluation of an eye-tracking pilot study proved that the use of AR favors the selection of prominent objects in the environment

Outlook a key role in the success of future developments is located

in the precision and quality of the hardware devices and especially to the accuracy of the built-in sensor components

a meaningful evaluation of the prototype requires a quantitative evaluation over a longer period and a repetition and expansion of the presented eye-tracking pilot test

Summary

Chapter 5| Summary


iccsa-2012

iccsa-2012

Thank You for your attention!

Mario Kluge & Hartmut Asche

University of Potsdam

Department of Geography

[email protected]

[email protected]

Validating a smartphone-based pedestrian navigation system prototype - An informal eye-tracking...

Technology

Transcript of Validating a smartphone-based pedestrian navigation system prototype - An informal eye-tracking...