W E L C O M E

A U G M E N T E D R E A L I T Y

A SEMINAR BYJEFFREY J M EC7AROLL NO:

AUGMENTED REALITY-INTRODUCTION

Augmented reality adds graphics, sounds, haptics and smell to the natural world as it exists

Refers to computer displays that add virtual information to a user's sensory perceptions.

focuses on see-through devices, usually worn on the head superimposes graphics over a real world environment in real time.

A R : O V E R V I E W

field of computer research which deals with the combination of real world and computer generated data

refers to computer displays that add virtual information to a user's sensory perceptions.

method for visual improvement or enrichment of the surrounding environment

introduced as the opposite of virtual reality

adds virtual computer-generated objects, audio and other sense enhancements

Goals of AR

• To enhance a person’s performance and perception of the world

ULTIMATE GOAL??

• Create a system such that no user CANNOT tell the difference between the real world and the virtual augmentation of it.

P R O P E R T I E S

• Combines real and virtual objects in a real environment

•Runs interactively, and in real time

•Registers (aligns) real and virtual objects with each other.

1960-used a see-through HMD

1997-Azuma published a survey

late 1990s-international Workshop and Symposium on Augmented Reality

Mixed Reality Systems Lab in Japan and the Arvika consortium in Germany

H I S T O R Y

Augmented Reality vs.Virtual Reality

Augmented Reality• System augments the real

world scene

• User maintains a sense of presence in real world

• Needs a mechanism to combine virtual and real worlds

Virtual Reality:• Totally immersive

environment

• Visual senses are under control of system (sometimes aural and proprioceptive senses too)

Miligram’s Reality-Virtuality Continuum

Miligram coined the term “Augmented Virtuality” to identify systems which are mostly synthetic with some real world imagery added such as texture mapping video onto virtual objects.

D I S P L A Y S

for viewing the merged virtual and real environments

Head-worn displays (HWD)

mount this type of display on their headsforms images directly on the retina.Two types of HWDs exist: optical see-through and video see-through.

Handheld displays.

use handheld, flat-panel LCD displaysacts as a window or a magnifying glass

Projection displays.

desired virtual information is projected directly on the physical objects

can cover large irregular surfaces using an automated calibration procedure

What Makes AR Work?

main components of system

backpack computer

differential GPS system

head-worn display interface

radio communication

This is how AR works.

• Pick A Real World Scene

•Add your Virtual Objects in it.•Delete Real World Objects

•Not Virtual Reality since Environment Real

Medical

Surgeon X-ray Surgeon X-ray vision: Minimally-vision: Minimally-invasiveinvasive brain surgery brain surgery

Manufacturing & Repair

VR HUDset used in the wire shop to VR HUDset used in the wire shop to connect the wires by showing an image connect the wires by showing an image of the circuit and information about type of the circuit and information about type

of wire to be used of wire to be used

Augmented view of River Wear in Augmented view of River Wear in Sunderland, Newcastle (U.K.) with a Sunderland, Newcastle (U.K.) with a

planned footbridge planned footbridge

Applications:

Annotation

Engine model part Engine model part labels appear as user labels appear as user points apoints at themt them

Virtual lines help diVirtual lines help displaysplay geometry of geometry of shuttle bay as shuttle bay as seen in orbitseen in orbit

Robot path planning

Virtual lines show planned motion of a robot armVirtual lines show planned motion of a robot arm

Entertainment

Screenshot from the Screenshot from the movie“Who Framed Roger Rabbit?” movie“Who Framed Roger Rabbit?” blending the real charblending the real character and background with computer acter and background with computer

generagenerated cartoon charactersted cartoon characters

Aircraft

Head Up Guidance System (HGS)Head Up Guidance System (HGS)

Boeing 737 cockpit with Head-up Boeing 737 cockpit with Head-up Display (HUD)Display (HUD)

Entertainment: Virtual actors

P e r f o r m a n c e I s s u e s

Augmented Reality systems are expected:• To run in real-time so that the user can move around freely in the

environment• Show a properly rendered augmented image

Therefore, two performance criteria are placed on the system:• Update rate for generating the augmenting image• Accuracy of the registration of the real and virtual image

Limitations for Updating the Generated Images

• Must be at 10 times/second

• More photorealistic graphics rendering

• Current technology does not support fully lit, shaded and ray-traced images of complex scenes

Failures in Registration

Failures in registration due to:

– Noise• Position and pose of camera with respect to the real scene• Fluctuations of values while the system is running

– Time delays• In calculating the camera position• In calculating the correct alignment of the graphics camera

Conclusion AR is a relatively new field (since 1993) and is far behind VR in

maturity.

Several vendors sell complete, turnkey VR systems.

No commercial vendor currently (??) sells an HMD-based AR system.

First deployed HMD-based AR system will probably be in the application of aircraft manufacturing (Boeing is currently exploring this technology extensively).

A breakthrough is required in real-time HMD tracking in the outdoors at the accuracy required by AR for this technology to move ahead rapidly.

AR has a great future as it promises better navigation and interaction with real and virtual world in ways which has previously been unimaginable.

T H A N K Y O U

Q U E R I E S ? ? ?