CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... ·...

19
Parag Chaudhuri, 2017 CS 775 Advanced Computer Graphics Lecture 1: Augmented Reality

Transcript of CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... ·...

Page 1: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

CS 775Advanced Computer Graphics

Lecture 1: Augmented Reality

Page 2: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

What is Augmented Reality?

Example: Cinema

Dawn of the Planet of Apes, Weta Digital, 2014

Page 3: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

What is Augmented Reality?

Example: Advertising

National Geographic, 2011

Page 4: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Example: Navigation

ROUTE 66 Maps + Navigation for Android, 2011

What is Augmented Reality?

Page 5: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

What is Augmented Reality?Example: Digital Heritage

The Parthenon, SIGGRAPH 2004 Electronic Theater

Page 6: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

What is Augmented Reality?

Example: Retail

Virtual Try-On, Zugara.com,

ViewAR, 2012

Page 7: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Example: In the Lab

What is Augmented Reality?

Self Adaptive Animation, Parag Chaudhuri, George Papagiannakis, Nada Magnenat-Thalmann, CGI 2008

Page 8: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Augmented Reality (AR) is a view of the physical, real world environment that is augmented by synthetic, computer­generated elements.

It was coined by Thomas Caudell, in 1990, while working at Boeing.

AR straddles the disciplines of  Computer Vision and Computer Graphics as it needs Vision to understand the real world and it needs Graphics to create the synthetic elements to augment it.

What is Augmented Reality?

ARToolkit, Hirokazu Kato, Mark Billinghurst, IWAR 1999

Page 9: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

The Real/Virtual Continuum

RealEnvironment

VirtualEnvironmentMixed Reality (MR)

Augmented Reality: A class of displays on the reality-virtuality continuum, Milgram 1994

Mixed Reality (MR)

Page 10: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

The Real/Virtual Continuum

RealEnvironment

VirtualEnvironmentMixed Reality (MR)

Tangible User Interfaces (TUI)

Tangible and Modular Input Device for Character Articulation, Jacobson et al., SIGGRAPH 2014

Page 11: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

The Real/Virtual Continuum

RealEnvironment

VirtualEnvironmentMixed Reality (MR)

Augmented Reality (AR)

Spatial ARComputer generated information is projected into a user's environment.

Augmented Reality Sandbox, Oliver Kreylos et al., 2013

Page 12: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

The Real/Virtual Continuum

RealEnvironment

VirtualEnvironmentMixed Reality (MR)

Augmented Reality (AR)

See-through ARComputer generated information is projected into a user's view of the real environment via a HMD or a screen.

www.ar-door.com2011

Page 13: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

The Real/Virtual Continuum

RealEnvironment

VirtualEnvironmentMixed Reality (MR)

Augmented Virtuality (AV)

Elements of the real world added to a virtual environment.

www.arlsura.com2012

Page 14: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

The Real/Virtual Continuum

RealEnvironment

VirtualEnvironmentMixed Reality (MR)

VirtualReality (VR)

The virtual environment often completely fills the user's field of view in immersive VR.

Tachi Lab, 2012Oculus Rift, 2013

Page 15: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Ingredients for AR

Life of Pi, Rhythm and Hues,2013

Capture the real world

Page 16: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Ingredients for AR

Life of Pi, Rhythm and Hues,2013

Capture the real world

Page 17: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Ingredients for AR

Life of Pi, Rhythm and Hues,2013

Model the virtual world

Capture the real world

Page 18: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Ingredients for AR

Life of Pi, Rhythm and Hues,2013

Augment

Capture the real world

Model the virtual world

Page 19: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment

Parag Chaudhuri, 2017

Homework● Look up and figure out:

— HoloLens (Microsoft)

— MagicLeap (magicleap.com)

— Vive (HTC), Oculus (Facebook), Gear VR (Samsung), Daydream VR (Google)

● See these:

— https://www.youtube.com/watch?v=Mv_eIRv1Vk4

— https://www.youtube.com/watch?v=x3A8D2f86qw