Photography Workshops - Learn How To Capture Images With Passion
Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography...
Transcript of Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography...
![Page 1: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/1.jpg)
Advanced Digital Photography
Geometry and Motion Capture
Lecture #11
September 29, 2015
Donald P. Greenberg
Visual Imaging in the Electronic Age
![Page 2: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/2.jpg)
Google Street View Car Fleet
October 15, 2012
![Page 3: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/3.jpg)
Google’s Autonomous Driving Vehicle 2010
http://erictric.com/2010/10/09/google-secretly-develops-tests-automated-cars/
![Page 4: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/4.jpg)
Google Street View
• The world contains roughly 50 million miles of roads, paved and unpaved,
across 219 countries (ref.)
• This is equivalent to circumnavigating the globe 1250 times.
• To date, hundreds of cities in many countries across four continents have
been captured.
• Google has developed several vehicular platforms and texture information in
the project’s seven year history.
Drafomir Anguelov, Carole Dulong, Daniel Filip, Christian Frueh, Stepheane Lafon, Richard Lyon, Abhijit Ogale, Luc Vincent, Josh Weaver. “Google Street View: Capturing The World At Street Level,” IEEE Computer, June 2010.
![Page 5: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/5.jpg)
Google Street View 2012
• 2011 Google announced it would start charging (large) commercial sites
• 2012 Google allows users to post photos and reviews of locations
By October 2012, Google will have updated 250,000 miles of U.S. roads
Note: They have also added Google Moon and Google Mars
![Page 6: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/6.jpg)
Google Street View Acquisition Map 2012
![Page 7: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/7.jpg)
Lombard Street, San Francisco
![Page 8: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/8.jpg)
Street View Vehicular Platforms
Modified Snowmobile
Drafomir Anguelov, Carole Dulong, Daniel Filip, Christian Frueh, Stepheane Lafon, Richard Lyon, Abhijit Ogale, Luc Vincent, Josh Weaver. “Google Street View: Capturing The World At Street Level,” IEEE Computer, June 2010.
![Page 9: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/9.jpg)
Using Street View data to enhance user walk-through experiences in Google Earth.
Fused 3D model with high-resolution
facades. The visual quality is
considerably higher, and many
storefronts and signs can now be easily
identified and recognized.
Drafomir Anguelov, Carole Dulong, Daniel Filip, Christian Frueh, Stepheane Lafon, Richard Lyon, Abhijit Ogale, Luc Vincent, Josh Weaver. “Google Street View: Capturing The World At Street Level,” IEEE Computer, June 2010.
Original 3D models of a New York
City scene from airborne data only.
![Page 10: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/10.jpg)
Imagery from new Street View Vehicle is accompanied by laser range data
Drafomir Anguelov, Carole Dulong, Daniel Filip, Christian Frueh, Stepheane Lafon, Richard Lyon, Abhijit Ogale, Luc Vincent, Josh Weaver. “Google Street View: Capturing The World At Street Level,” IEEE Computer, June 2010.
- which is aggregated and simplified by robustly fitting it in a coarse mesh that models
the dominant scene surfaces.
![Page 11: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/11.jpg)
Digital Geometry Capture
• Photographic methods
• Time of Flight
• Radar
• Sonar
• All of the Above
![Page 12: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/12.jpg)
Sensors on Google’s ADV
![Page 13: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/13.jpg)
Sensors on Google’s ADV
![Page 14: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/14.jpg)
Google’s Autonomous Driving Vehicle 2013
• Uses multiple sensors, each with a different view of the world
• Laser
– 64 beams @ 10 revolutions/second scanning 1.3 million points in concentric waves
starting 8 feet from the car
– It can spot a 14” object at a distance of 160 feet
• Radar
– Has twice the range of the Laser, but much less precision
• Photography
– Excellent at identifying road signs, turn signals, colors and lights
![Page 15: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/15.jpg)
Google’s Autonomous Driving Vehicle 2014-2015
• New laser sensors
– 2 X range
– 30 X resolution
– @ 300’ can spot a metal plate <2” thick
– Size of a coffee mug
– Cost $10,000 (less than current model @ $80,000)
![Page 16: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/16.jpg)
Autonomous Driving Vehicles Pre-2000
• “There was no way, before 2000, to make something interesting”
• “The sensors weren’t there
• The computers weren’t there
• The mapping wasn’t there”
• “Radar was a device on a hilltop that cost $200M”
Sebastian Thrun
Founder of the Google Car Project
![Page 17: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/17.jpg)
Will We Have Autonomous Driving Vehicles?
• Every decade another bit of automation is introduced:
– 1950s Power steering
– 1970s Cruise control
– 1980s Anti-lock brakes
– 1990s Electronic stability control
– 2000s The first self-parking cars
• Now Detection of lane lines
Distance from car ahead
Night vision
Blind spot detection
Stereo cameras to identify pedestrians
![Page 18: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/18.jpg)
![Page 19: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/19.jpg)
![Page 20: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/20.jpg)
The Game of Drones
Scie
nce M
agazin
e,
30.J
an.2
015 –
The E
nd o
f P
rivacy
![Page 21: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/21.jpg)
Capturing Motion
![Page 22: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/22.jpg)
Kinect 2
![Page 23: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/23.jpg)
The Kinect uses a pattern projection and machine learning
• Inferring body position is a two-stage process: First Compute a depth map
(using projected pattern), then infer body position (using machine learning)
![Page 24: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/24.jpg)
Point Cloud Drawn from the Kinect’s 3D data
![Page 25: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/25.jpg)
Step 1: Compute a Depth Map
![Page 26: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/26.jpg)
Extracted Skeleton Kinect
![Page 27: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/27.jpg)
Step 2: Infer a Body Position
![Page 28: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/28.jpg)
Skeleton Manipulation
![Page 29: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/29.jpg)
Tracking
![Page 30: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/30.jpg)
Motion Capture Markers
![Page 31: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/31.jpg)
Motion Capture
© ILM
![Page 32: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/32.jpg)
Seven Universal Expressions of Emotion
• Paul Ekman
![Page 33: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/33.jpg)
Inside Out
![Page 34: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/34.jpg)
Markerless Motion Capture
http://macanimationpro.digitalmedianet.com/articles/viewarticle.jsp?id=54623
![Page 35: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/35.jpg)
The Curious Case of Benjamin Button 2008
Cinefex 116, January 2009
![Page 36: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/36.jpg)
The Curious Case of Benjamin Button 2008
Cinefex 116, January 2009
![Page 37: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/37.jpg)
The Curious Case of Benjamin Button 2008
Cinefex 116, January 2009
![Page 38: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/38.jpg)
Seven Universal Expressions of Emotion
• Paul Ekman
![Page 39: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/39.jpg)
Affective Computing
![Page 40: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/40.jpg)
Affidex Software
• Scan the image for a face(s) and isolates one.
• Using feature detection algorithms, identify the face’s main regions (mouth,
nose, eyes, eyebrows, etc.) and ascribe dots to each.
• Separate the dots into “deformable” and “non-deformable” points.
• Deformable points serve as anchors to estimate the magnitude of movement.
![Page 41: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/41.jpg)
Affective Computing
• “I think that, ten years down the line, we won’t
remember what it was like when we couldn’t just
frown at our device, and our device would say, “Oh,
you didn’t like that, did you?”
– Rana el Kaliouby
Affectiva
![Page 42: Advanced Digital Photography Geometry and Motion Capture 11... · Advanced Digital Photography Geometry and Motion Capture Lecture #11 September 29, 2015 Donald P. Greenberg Visual](https://reader034.fdocuments.in/reader034/viewer/2022042918/5f5fcbe2b620d026dd4eff5d/html5/thumbnails/42.jpg)
End