Augmented RealityK.S. RAJU CSE-A

Agenda1) What is Augmented Reality?2) Augmented Reality vs Virtual Reality.3) AR System.4) Requirements.5) Types of Augmented Reality.6) Key issues of AR.7) Applications of AR.

What is Augmented Reality? Combination of two environments

i. the real environment viewed by the user.

ii. a virtual environment generated by the computer.

+ =

Term “Augmented Reality”

Real environment is augmented by means of virtual objects

Supplements reality, instead of completely replacing it

Image-enhanced by

inserting additional information.

removing the unnecessary region.

Why research this?

Enhances person’s perception.

Enhances person’s performance.

Provides a user with

work efficiency, convenience, interesting effects, and information in industry, education, entertainment, etc.

Virtual Reality

Augmented Reality in a nut shell:

Augumented Reality vs Virtual RealityVirtual Reality Augmented Reality

A user is fully immersed in Virtual Reality. Inserting virtual objects into real environment.

AR and VR statistics:

Realism-Modeling-Interaction

AR System Requirements of AR system

Blending real and virtual

Real-time interaction

Registration between 3D and 2D

Portability for wearable AR

Non-AR system:

Composition in film (ex. “Jurassic Park”)

Photorealistic virtual object

But not interactive media

2D virtual overlay (ex. “captions in TV”)

Interactive in real-time

But not combined with the real world in 3D

Requirements

Types of Augmented Reality

Device-based AR:

Uses hardware equipment.

Acquiring position data from position tracker, magnetic sensors, GPS, etc.

Including the camera(s).

Vision-Based AR:

Only uses a camera or multiple cameras

Estimating user’s position from input images

Device based AR: Architecture and Working of Device based AR:

Image Capture

Camera Frame

Grabber

Display-Out

Monitor or HMD

AR Processing

Synthesis

Virtual Object

Rendering

Positioncalculation

Data acquisition

Measuring instruments

Vision based AR: Architecture and Working of Vision based AR:

Display-Out AR Processing

Image Capture

Camera Frame

Grabber

Feature extraction& tracking

Monitor or HMD

SynthesisVirtual Object

Rendering

CameraCalibration

Buffer

Key technical issues in AR 3D Modeling

generates a virtual object to be inserted

Display device

displays mixed scenes with real and virtual environments

Calibration

estimates camera parameters

calculates transform between real and virtual world coordinates

Tracking

detects user’s position and orientation chases feature points for vision based tracking

Registration

merges a virtual object into real environment exactly

3D Modelling 3D model design tools

ex) Mayatm, SoftImagetm, …

3D reconstruction from images

Range Finder (Laser scanner)

Display Devices

Optical see-through Head Mounted Device(HMD)

Micro optic Head Mounted Device (HMD)

Calibration Calculate the camera’s parameters

intrinsic(focal length, principal points, axes’ scale/skew) and extrinsic(position, direction) parameters

Camera Calibration Toolbox for Matlab

http://www.vision.caltech.edu/bouguetj/calib_doc/

Tracking & Registration Tracking

Report the locations and orientations of the user and the surrounding objects in the environment.

continually matched with the user’s real-world andthe computer generated virtual-world.

Registration

Virtual and real worlds must be properly aligned.

If not

compromises illusion that the two coexist

prevents acceptance of many applications

Application of AR in Entertainment

Application of AR in Marketing

Application of AR by TOYOTA Automobiles

Application of AR in Games

Application of AR in Navigation

Application of AR in Automobile, Medical and Military

Application of AR in Technology and Fiction

Application of AR in Social Networking

Thank you.