Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… ·...
Transcript of Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… ·...
![Page 1: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/1.jpg)
Mobile Outdoor Gaze-Based
GeoHCI
Ioannis Giannopoulos, Peter Kiefer, Martin Raubal
27 April 2013
GeoHCI Workshop, Paris
![Page 2: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/2.jpg)
2
GIScience & Cognitive Engineering
The 3 Spatial Components
![Page 3: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/3.jpg)
3
‘Spatial for HCI’
• Geographic Information Science
– systematic study of all aspects regarding
geographic information
– foundation for development of geospatial tools
& services that support people in their spatio-
temporal decision-making
• Useful & useable solutions => principles
of human spatial cognition regarding
representation & processing of spatial and
temporal aspects of phenomena
![Page 4: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/4.jpg)
4
BR
IDG
E T
HE
GA
P
![Page 5: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/5.jpg)
5
Gulf of evaluation
Goals, intentions, concepts, spatial and
cognitive abilities
Gulf of execution
Physical system variables
![Page 6: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/6.jpg)
6
Cognitive engineering
• Donald Norman: integrate cognitive &
computer science approaches to the
design and construction of machines.
• ‘a type of applied cognitive science’
• People’s interactions with everyday
things (telephones, faucets, doors)
=> discrepancy between
psychological user variables &
physical system variables.
![Page 7: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/7.jpg)
7
Spatial cognitive engineering
• Human-computer interaction regarding
spatial & temporal aspects of phenomena
in the world.
• Spatio-temporal reasoning is complex.
• People’s queries when using geospatial
tools have a spatio-temporal context =>
geographic relevance [Raper]
• Goes beyond user-interface level!
![Page 8: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/8.jpg)
8
Mobility
© Rüdiger Wölk
![Page 9: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/9.jpg)
9
Mobile Location Based Services
• Deliver information to user based on her
current location.
• Navigation and information
services
• Emergency services
• Field applications
• Geoservices for
mobile phones, PDA,
etc.
![Page 10: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/10.jpg)
10
WikEar – educational audio tour
by Johannes Schöning
![Page 11: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/11.jpg)
11
Spatio-temporal constraints
Multiple spaces,
types of times,
cognitive & social
processes, …
[Raubal & Panov 2009; Richter, Dara-Abrams, & Raubal 2010]
![Page 12: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/12.jpg)
12
GIScience & Cognitive Engineering
The 3 Spatial Components
![Page 13: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/13.jpg)
13
Eye Tracking
Gaze Recording
– «Where has a person looked at?»
– Assumption: gaze implies perception.
– Fixations and saccades.
Mobile Eye Tracker Remote Eye Tracker
© S
ensom
oto
ric I
nstr
um
ents
(C)
Erg
oneers
Reading Research
Wik
imedia
: P
ublic
Dom
ain
![Page 14: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/14.jpg)
14
Wayfinding Assistance
Gaze-based wayfinding assistant location-aware mobile gaze-based interaction
w.r.t. three spatial components.
![Page 15: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/15.jpg)
15
The 3 spatial components
• The space the user interacts in (i.e., the
position of the user).
• The spatial information the user interacts
with (e.g., the information on the map).
• The space the user interacts with (i.e., the
objects in the environment gazed at).
![Page 16: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/16.jpg)
16
The spatial information the user
interacts with
![Page 17: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/17.jpg)
17
Gaze Map Matching
Interpretation with respect to vector features.
![Page 18: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/18.jpg)
18
GeoGazemarks
• Interactive concept to
represent the view
(usage) history on
mobile maps.
• Fixations are clustered
geospatially, and
visualized when the
user zooms out.
• Visual clue to facilitate
orientation.
![Page 19: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/19.jpg)
19
The space the user interacts
with
![Page 20: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/20.jpg)
20
The objects in the environment
gazed at
![Page 21: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/21.jpg)
21
The objects in the environment
gazed at
automate the analyses for recorded eye
tracking data.
interaction with the real environment.
Object of regard
identification through
eye, location and head
tracking.
![Page 22: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/22.jpg)
22
Augmented Reality Glasses
• Example: Google
Project Glass
http
://com
mons.w
ikim
edia
.org
/wik
i/File
_G
lass_deta
il.jpg
GN
U F
ree
Do
cu
menta
tion L
icense, V
ers
ion 1
.2, A
uth
or: A
nto
nio
Zu
gald
ia
(C) Google, http://www.youtube.com/watch?v=9c6W4CCU9M4
http://www.techradar.com/news/portable-devices/google-patents-eye-
tracking-for-google-glass-1091428
![Page 23: Mobile Outdoor Gaze-Based GeoHCI - University of Minnesotabhecht/geohci2013ps/Raubal_GEOH… · Mobile Outdoor Gaze-Based GeoHCI Ioannis Giannopoulos, Peter Kiefer, Martin Raubal](https://reader036.fdocuments.in/reader036/viewer/2022081406/5f0d4e127e708231d439b014/html5/thumbnails/23.jpg)
23
Mobile Eye Tracking Lab
For video demos of our research, search for gis@ethz http://www.youtube.com/user/ETHzurichGIS
Thank you for your attention!