Augmented realityGeneration “Hand bag” ”Keyhole AR” • • • • AR Visor Concept Film...
76
Augmented reality
Transcript of Augmented realityGeneration “Hand bag” ”Keyhole AR” • • • • AR Visor Concept Film...
Augmented reality
The vision?
Augmented City, Keiichi Matsuda
“ Augmented Reality is identified as one of the top ten most disruptive new technologies for 2008 -2012…
Definition
AR is a technology which
1. Superimposes virtual information on the real world
2. Is interactive in real time
3. Is spatial – the virtual objects are registered and interactive in 3D space
Azuma (1997)
The evolution of Augmented Reality hardware
Steve Mann
Generation “Kit bag”
Generation “Hand bag”
”Keyhole AR”
•
•
•
•
AR Visor Concept
Ok, fine. But what should we use it for?
Experiences for tourists & visitors
Experiences for tourists & visitors
HistoriskaSkyltar P l a t s b a s e r a d h i s t o r i a i ö g o n b l i c k e t
Experiences for tourists & visitors
Master thesis at Faculty of Engineering, Lund university Sofia Holmgren
Experiences for tourists & visitors
Marketing
Sales
Games
Social media
A closer look at AR technology
• Displays
• Tracking
• Interaction
Displays
Wearable displays
Optical see-through Video see-through
Optical see-through
• Natural, instantaneous view
• Zero parallax
Video see-through
• Better consistency between real and virtual views
• Better handling of occlusion problems
Projection-based displays
sixth sense MIT
OmniTouch
Tracking
The “Holy Grail” of AR
Tracking
• The act of aligning the virtual content with the real world view
Tracking techniques
• Sensor-based
• Vision-based
• Hybrid
Tracking techniques
• Sensor-based
• Vision-based
• Hybrid
Sensor-based tracking
• Electromagnetic
• Acoustic
• Optical
• Inertial
Micro Electro-Mechanical Systems (MEMS)
Inertial tracking
• Fast
• Robust
• Drift
Tracking techniques
• Sensor-based
• Vision-based
• Hybrid
Vision-based tracking techniques
• Low jitter
• No drift
• Calculation-intensive
• Sensitive (e.g. light-conditions)
Vision-based tracking
– Marker-based
– Feature-based
– Model-based
Marker-based tracking
Vision-based tracking
– Marker-based
– Feature-based
– Model-based
Feature-based tracking
• Using natural features in the camera image
Feature-based tracking
• The PTAM method on iPhone
George Klein’s homepage
Film clip
Feature-based tracking
Face recognition
• TAT Augmented ID
Film clip
Vision-based tracking
– Marker-based
– Feature-based
– Model-based
Model-based tracking
• 3d models used as reference to minimize the tracking error
Tracking techniques
• Sensor-based
• Vision-based
• Hybrid
Camera
Accelerometer, gyroscope & compass
Hybrid tracking techniques
If we analyze the tracking technologies available outdoors we find that no single technology provides a complete solution. Combining several tracking technologies, or hybrid tracking, is the only feasible approach […]
“ Azuma (1999)
TOWNWEAR
Satoh et al (1999)
TOWNWEAR
• Gyroscope
• Vision-based drift compensation
(feature-based)
Two minutes
With compensation
Without compensation
20 minutes
With compensation
Without compensation
40 minutes
With compensation
Without compensation
Interaction
Interaction
• ISMAR 2011 papers and posters
• User interfaces, interaction, human factors, ergonomics, perception: ≈14%
ISMAR 2011
Perceptually correct augmentation remains a crucial challenge. ”
Ernst,, Kruijff, Swan, J. E., & Steve,, Feiner (2010). Perceptual Issues in Augmented Reality Revisited. IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2010). Seoul, Korea.
Vergence-accomodation conflict
• Eyes focusing at a distance that differs from the point of visual convergence
Attention resources
R&D challenges for AR interaction
• How will perceptual, cognitive, affective and social factors influence the design of AR interaction?
• How can AR interaction be prototyped and tested with high ecological validity?
Some interaction styles
Tangible AR
• The user can manipulate the virtual information through physical objects
Gestures
Some popular AR platforms
Layar
Layar: tracking
• Default tracking
– ”Geo tracking” (GPS, compass)
– Inertial tracking (accelerometers)
• Layar Vision
– Feature-based tracking
Junaio
String
• Marker-based tracking
• Fully integrated with game development tool Unity
• iOS
• Coming soon for Android
So, where are we today?
Definition
AR is a technology which
1. Superimposes virtual information on the real world
2. Is interactive in real time
3. Is spatial – the virtual objects are registered and interactive in 3D space
Azuma (1997)
Definition
AR is a technology which
1. Superimposes virtual information on the real world
2. Is interactive in real time
3. Is spatial – the virtual objects are registered and interactive in 3D space
Azuma (1997)
Information sources
• Blogs
– http://gamesalfresco.com
– http://thomaskcarpenter.com/
– http://sweetar.com/blogg/
– http://keiichimatsuda.tumblr.com/
• The conference ISMAR
Facebook group
Thanks for listening! Questions?
