CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 ·...
Transcript of CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 ·...
![Page 1: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/1.jpg)
CEE598 -Visual Sensing for
Civil Infrastructure Eng. & Mgmt.
Session 3 – Camera Model and
Projective Geometry
UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN
Mani Golparvar-FardDepartment of Civil and Environmental Engineering
Department of Computer Science
3129D, Newmark Civil Engineering Lab
e-mail: [email protected]
![Page 2: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/2.jpg)
Spike (ikeGPS
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
2
http://www.youtube.com/watch?v=67G9QUnr
bzM&feature=share&list=UUciHOBqGriqsyo5s
3xkdiWw&index=10
![Page 3: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/3.jpg)
Structure
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
3
(http://structure.io/#)
![Page 4: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/4.jpg)
Illinois Compass2g Site> Course Contents> Supplementary Documents> 3DVision.avi
A00: watch
Marilia Maschion Producer & Director UCSD ICAM undergraduate
Vincent Rabaud Technical Advisor UCSD CSE student
Serge Belongie Project Advisor UCSD CSE Department
A0: review SVD decomposition
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
4
![Page 5: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/5.jpg)
Outline
Cameras
• Pinhole cameras
• Cameras & lenses
• The geometry of pinhole cameras
• Other camera models
• Next Class
Readings:
• [FP] Chapters 1 – 3
• [HZ] Chapter 6
5
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
Temporary structures, site profile, foundation
walls, and slab rebars are reconstructed
Image View
3D View
(a)
(b)
(c)
Some of the slides in this lecture are courtesy to Prof. Jon Ponce,
University of Illinois, Prof. Silvio Savarese, University of Michigan and
Profs. Marc Levoy and Fei-Fei Li, Stanford University.
![Page 6: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/6.jpg)
Outline
Cameras
• Pinhole cameras
• Cameras & lenses
• The geometry of pinhole cameras
• Other camera models
Without cameras, we wouldn't have Visual Sensing
Class
6
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
![Page 7: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/7.jpg)
Daily Construction Photos
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
7©2011, Construction Performance Improvement Class, Mani Golparvar-Fard (Photo Courtesy of Anthony Lee)
At the front left-side of the site lies spare sections of the work platforms, presumably to be used around the back of the building when time
comes.
![Page 8: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/8.jpg)
Daily Construction Photos
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
8©2011, Construction Performance Improvement Class, Mani Golparvar-Fard (Photo Courtesy of Anthony Lee)
At the first floor, it is clearly not as far along as the top two floors. Here, drywall and insulation installation has not even begun.
![Page 9: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/9.jpg)
Daily Construction Photos
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
9A DEWALT rotary laser is used to pinpoint exact height levels for construction. Also in this picture, one can see the fireproofing
material applied on all steel elements of the structure.
©2011, Construction Performance Improvement Class, Mani Golparvar-Fard (Photo Courtesy of Anthony Lee)
![Page 10: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/10.jpg)
How do we see the world?
Let’s design a camera
• Idea 1: put a piece of film in front of an object
• Do we get a reasonable image?
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
10
![Page 11: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/11.jpg)
Pinhole camera
Add a barrier to block off most of the rays
• This reduces blurring
• The opening known as the aperture
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
11
![Page 12: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/12.jpg)
f
f = focal length
c = center of the camera
c
Pinhole camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
12
![Page 13: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/13.jpg)
Milestones:
• Leonardo da Vinci (1452-1519): first
record of camera obscura
Some history…
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
13
![Page 14: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/14.jpg)
Milestones:
• Leonardo da Vinci (1452-1519):
first record of camera obscura
• Johann Zahn (1685): first
portable camera
Some history…
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
14
![Page 15: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/15.jpg)
Photography (Niepce, “La
Table Servie,” 1822)
Milestones:
• Leonardo da Vinci (1452-1519):
first record of camera obscura
• Johann Zahn (1685): first portable
camera
• Joseph Nicephore Niepce (1822):
first photo - birth of photography
• Daguerréotypes (1839)
• Photographic Film (Eastman, 1889)
• Cinema (Lumière Brothers, 1895)
• Color Photography (Lumière Brothers,
1908)
• First Digital Camera (Kodak, 1975)
• Picture of Steve Sasson
Some history…
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
15
![Page 16: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/16.jpg)
Let’s also not forget…
Motzu
(468-376 BC)
Aristotle
(384-322 BC)
Also: Plato, Euclid
Al-Kindi (c. 801–
873)
Ibn al-Haytham
(965-1040)Oldest existent
book on geometry
in China
Omar Khayyam
(1080-1131)
Non-Euclidean
Geometry
Parallel postulate
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
16
![Page 17: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/17.jpg)
z
yf'y
z
xf'x
y
xP
z
y
x
P
Derived using similar triangles
Pinhole camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
17
![Page 18: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/18.jpg)
O
P = [x, z]
P’=[x’, f]
f
z
x
f
x
x
z
Pinhole camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
18
![Page 19: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/19.jpg)
Common to draw image plane in front of
the focal point. Moving the image plane
merely scales the image.
f f
z
yf'y
z
xf'x
Pinhole camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
19
![Page 20: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/20.jpg)
Kate lazuka ©
Is the size of the aperture important?
Pinhole camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
20
![Page 21: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/21.jpg)
Effect of the Pinhole Size
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
21
Adapted from Levoy (2011)
![Page 22: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/22.jpg)
Replacing the Pinhole with a Lens
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
22
Adapted from Levoy (2011)
![Page 23: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/23.jpg)
Cameras & Lenses
A lens focuses light onto the film
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
23
![Page 24: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/24.jpg)
Cameras & Lenses
A lens focuses light onto the film
• Rays passing through the center are not deviated
• All parallel rays converge to one point on a plane
located at the focal length f
focal point
f
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
24
![Page 25: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/25.jpg)
Cameras & Lenses
A lens focuses light onto the film
• There is a specific distance at which objects are “in
focus”
[other points project to a “circle of confusion” in the image]
“circle of
confusion”
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
25
![Page 26: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/26.jpg)
Geometrical Optics
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
26
Adapted from Levoy (2011)
![Page 27: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/27.jpg)
Gauss’ Ray Tracing Construction
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
27
Adapted from Levoy (2011)
![Page 28: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/28.jpg)
Changing the Focus Distance
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
28
To focus on
objects at
different
distances,
move sensor
relative to
lens
Adapted from Levoy (2011)
![Page 29: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/29.jpg)
Changing the Focal Length
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
29
Adapted from Levoy (2011)
![Page 30: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/30.jpg)
Changing the Focal Length
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
30
![Page 31: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/31.jpg)
Focal Length and Field of View
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
31
![Page 32: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/32.jpg)
Focal Length and Field of View
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
32
Adapted from Levoy (2011)
![Page 33: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/33.jpg)
Changing the Sensor Size
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
33
Adapted from Levoy (2011)
![Page 34: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/34.jpg)
Camera Sensor Sizes
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
34
Adapted from Levoy (2011)
![Page 35: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/35.jpg)
Changing the Focal Length vs. the Viewpoint
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
35
Changing the focal length lets us move back from a
subject, while maintaining its size on the image
Notice that moving back changes perspective
relationships
Wide-angle Telephoto and
Moved back
Adapted from Levoy (2011)
![Page 36: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/36.jpg)
Changing the Focal Length vs. the Viewpoint
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
36
Moving back while changing the focal length lets you keep objects at one depth the same size
In cinematography, this is called the dolly zoom, or “Vertigo effect”, after Alfred Hitchcock’s movie
Adapted from Levoy (2011)
![Page 37: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/37.jpg)
Changing the Focal Length vs. the Viewpoint
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
37
![Page 38: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/38.jpg)
Effect of focal length on portraits
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
38
Focal length is getting longer
Standard “portrait lens” is 85mm
Wide angle Standard Telephoto
![Page 39: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/39.jpg)
Exposure
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
39
𝐻 = 𝐸 × 𝑇
Exposure = Irradiance × Time
Irradiance (E)
• Amount of light falling on a unit area of sensor
per second
• Controlled by aperture
Exposure Time (T)
• In seconds
• Controlled by shutter
![Page 40: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/40.jpg)
Single Lens Reflex Camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
40
Adapted from Levoy (2011)
![Page 41: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/41.jpg)
Shutters
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
41
Adapted from Levoy (2011)
![Page 42: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/42.jpg)
Low Shutter Speed
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
42http://www.annedarlingphotography.com/images/slow-shutter-speed-2-0.jpg
![Page 43: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/43.jpg)
Shutter Speed
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
43
Adapted from Levoy (2011)
Controls how long the sensor is exposed to light
Linear effect on exposure until sensor saturates
Denoted in fractions of a second:
• 1/2000, 1/1000,...,1/250, 1/125, 1/60,...,15, 30
Normal humans can hand-hold down to 1/60
second
• Rule of thumb: shortest exposure = 1 / 𝑓
e.g., 1/180 second for a 180mm lens
![Page 44: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/44.jpg)
Main Side-effect of Shutter Speed
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
44
Motion blur
Doubling exposure time doubles motion blur
Adapted from Levoy (2011)
![Page 45: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/45.jpg)
Useful Shutter Speeds
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
45
Adapted from Levoy (2011)
![Page 46: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/46.jpg)
Useful Shutter Speed
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
46
Adapted from Levoy (2011)
![Page 47: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/47.jpg)
Useful Shutter Speed
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
47
1/800 sec
![Page 48: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/48.jpg)
Aperture
Irradiance on sensor is proportional to
• Square of aperture diameter A
• Inverse square of distance to sensor (~ focal
length f )
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
48
http://photoluminary.com/wp-content/uploads/2011/03/aperture_diagram.jpg
![Page 49: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/49.jpg)
Irradiance on Sensor
As the diameter A of the aperture doubles, its area (hence the light that can get through it) increases by 4x.
Think of the lens as a collection of pinholes, each having a fixed angular field of view (cone in 2nd drawing) determined by the lens design.
A certain amount of light gets through each pinhole. By conservation of energy, that light will fall on whatever sensor is placed in its path.
If the distance to the sensor is doubled, the area intersecting the cone increases by 4x, so the light falling per unit area decreases by 4x.
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
49
Adapted from Levoy (2011)
![Page 50: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/50.jpg)
Aperture
Irradiance on sensor is proportional to square of aperture diameter A
Inverse square of distance to sensor (~ focal length f )
so that aperture values give irradiance regardless of lens,
• Aperture number N is defined relative to focal length
• f/2.0 on a 50mm lens means the aperture is 25mm
• f/2.0 on a 100mm lens means the aperture is 50mm
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
50
𝑁 =𝑓
𝐴
Adapted from Levoy (2011)
![Page 51: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/51.jpg)
Example of F-number calculations
A relative aperture size (called F-number or just N) of 2 is written f/2, reflecting the fact that it is computed by dividing focal length (f) by the absolute aperture diameter (A).
Doubling both the absolute aperture diameter (A) and the focal length (f) cancel; leaving the same relative aperture size (N).
In this example, both lenses are f/2.
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
51
Adapted from Levoy (2011)
![Page 52: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/52.jpg)
Aperture
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
52
Adapted from Levoy (2011)
![Page 53: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/53.jpg)
Depth of Field
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
53
Adapted from Levoy (2011)
![Page 54: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/54.jpg)
Trading off motion blur and depth of field
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
54
Adapted from Levoy (2011)
![Page 55: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/55.jpg)
Sensitivity (ISO)
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
55
Adapted from Levoy (2011)
![Page 56: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/56.jpg)
Tradeoff Affecting Brightness
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
56
Adapted from Levoy (2011)
![Page 57: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/57.jpg)
Canon EOS C300
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
57
![Page 58: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/58.jpg)
Canon EOS C300
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
58
![Page 59: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/59.jpg)
Snell’s law
n1 sin1 = n2 sin 2
1 = incident angle
2 = refraction angle
ni = index of refraction
Cameras & Lenses
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
59
![Page 60: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/60.jpg)
Snell’s law:
n1 sin 1 = n2 sin 2
Small angles:
n1 1 n2 2
n1 = n (lens)
n1 = 1 (air) )1n(2
Rf
f
1
z
1
'z
1
zo
Thin Lenses
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
60
![Page 61: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/61.jpg)
z
y'z'y
z
x'z'x
ozf'z
zo
)1n(2
Rf
Thin Lenses
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
61
![Page 62: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/62.jpg)
Issues with lenses: Spherical aberration
Rays farther from the
optical axis focus closer
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
62
![Page 63: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/63.jpg)
No distortion
Pin cushion
Barrel
Issues with lenses: Radial Distortion
• Caused by imperfect lenses
• Deviations are most noticeable for rays that pass through the
edge of the lens
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
63
![Page 64: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/64.jpg)
Outline
Cameras
• Pinhole cameras
• Cameras & lenses
• The geometry of pinhole cameras
• Other camera models
64
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
![Page 65: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/65.jpg)
Pinhole perspective projectionf
f = focal length
c = center of the camera
c
)z
yf,
z
xf()z,y,x(
2E
3
Pinhole camera
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
65
![Page 66: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/66.jpg)
Is this a linear transformation?
No — division by z is nonlinear
How to make it linear?
)z
yf,
z
xf()z,y,x(
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
66
![Page 67: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/67.jpg)
Homogeneous coordinates
homogeneous image
coordinates
homogeneous scene
coordinates
• Converting from homogeneous coordinates
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
67
![Page 68: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/68.jpg)
Perspective Projection Transformation
1
z
y
x
0100
00f0
000f
z
yf
xf
X
z
yf
z
xf
iX
XMX
M
3H
4
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
68
![Page 69: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/69.jpg)
Pixels, bottom-left coordinate systems
From retina plane to images
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
69
![Page 70: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/70.jpg)
xc
yc
Coordinate systems
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
70
![Page 71: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/71.jpg)
x
y
xc
yc
C=[cx, cy]
)cz
yf,c
z
xf()z,y,x( yx
1. Off set
Converting to pixels
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
71
![Page 72: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/72.jpg)
)cz
ylf,c
z
xkf()z,y,x( yx
1. Off set
2. From metric to pixels
x
y
xc
yc
C=[cx, cy] Units: k,l : pixel/m
f : m: pixel
, Non-square pixels
Converting to pixels
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
72
![Page 73: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/73.jpg)
Matrix form?
x
y
xc
yc
C=[cx, cy]
)cz
y,c
z
x()z,y,x( yx
Converting to pixels
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
73
![Page 74: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/74.jpg)
)cz
y,c
z
x()z,y,x( yx
1
z
y
x
0100
0c0
0c0
z
zcy
zcx
X y
x
y
x
x
y
xc
yc
C=[cx, cy]
Camera Matrix
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
74
![Page 75: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/75.jpg)
XMX
X0IK
1
z
y
x
0100
0c0
0c0
X y
x
Camera
matrix K
Camera Matrix
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
75
![Page 76: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/76.jpg)
1
z
y
x
0100
0c0
0cs
X y
x
Skew parameter
x
y
xc
yc
C=[cx, cy]K has 5 degrees of freedom!
Finite projective cameras
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
76
![Page 77: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/77.jpg)
Ow
iw
kw
jwR,T
World reference system
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
77
![Page 78: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/78.jpg)
3D Rotation of Points
Rotation around the coordinate axes, counter-clockwise:
100
0cossin
0sincos
)(
cos0sin
010
sin0cos
)(
cossin0
sincos0
001
)(
z
y
x
R
R
R
p
x
Y’
p’
g
x’
y
z
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
78
![Page 79: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/79.jpg)
wXMX wXTRK
Ow
iw
kw
jwR,T
wXTRX
In 4D homogeneous coordinates:
Internal parameters External parameters
World reference system
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
79
![Page 80: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/80.jpg)
wx XMX 4313
14w4333 XTRK
Ow
iw
kw
jwR,T
How many degrees of freedom?
5 + 3 + 3 =11!
100
c0
cs
K y
x
Projective cameras
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
80
![Page 81: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/81.jpg)
Ow
iw
kw
jwR,T
)X
X,
X
X()z,y,x(
w3
w2
w3
w1w
m
m
m
m M is defined up to scale!
Multiplying M by a scalar
won’t change the image
w13 XMX
14w4333 XTRK
3
2
1
m
m
m
M
Projective cameras
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
81
![Page 82: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/82.jpg)
][ bATKRKTRKM
3
2
1
a
a
a
A
100
0 y
x
c
cs
K
lf
;kf
Theorem (Faugeras, 1993)
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
82
![Page 83: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/83.jpg)
•Points project to points
•Lines project to lines
Properties of Projection
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
83
![Page 84: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/84.jpg)
•Distant objects look smaller
z
y'f'y
z
x'f'x
Image plane
scene
Properties of Projection
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
84
![Page 85: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/85.jpg)
•Angles are not preserved
•Parallel lines meet!Vanishing point
Properties of Projection
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
85
![Page 86: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/86.jpg)
• Each set of parallel lines meets at a different point
[The vanishing point for this direction]
•Sets of parallel lines on the same plane lead to collinear vanishing
points [The line is called the horizon for that plane]
Vanishing points
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
86
![Page 87: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/87.jpg)
One-point perspective
Masaccio, Trinity,
Santa Maria Novella,
Florence, 1425-28
Credit slide S. Lazebnik CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
87
![Page 88: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/88.jpg)
The exterior columns appear bigger
The distortion is not due to lens flaws
Problem pointed out by DaVinci
Slide by F. Durand Credit slide S. Lazebnik
Properties of ProjectionObjects on the periphery are expanded
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
88
![Page 89: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/89.jpg)
Properties of Projection
Degenerate cases
• Line through focal point projects to a point.
• Plane through focal point projects to line
• Plane perpendicular to image plane projects to part of
the image (with horizon).
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
89
![Page 90: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/90.jpg)
Outline
Cameras
• Pinhole cameras
• Cameras & lenses
• The geometry of pinhole cameras
• Other camera models
90
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
![Page 91: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/91.jpg)
0
'where
'
'
z
fm
myy
mxx
is the magnification.
P~
When the relative scene depth is small compared to its distance from the camera
Weak perspective projection
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
91
![Page 92: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/92.jpg)
y'y
x'x
When the camera is at a (roughly constant) distance from the scene
–Distance from center of projection
to image plane is infinite
Orthographic (affine) projection
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
92
![Page 93: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/93.jpg)
Pros and Cons of These Models
Weak perspective much simpler math.• Accurate when object is small and distant.
• Most useful for recognition.
Pinhole perspective much more accurate for scenes.• Used in structure from motion.
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
93
![Page 94: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/94.jpg)
Qingming Festival by the Riverside Zhang Zeduan ~900 AD
Weak perspective projection
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
94
![Page 95: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/95.jpg)
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
The Kangxi Emperor's Southern Inspection Tour (1691-1698) By Wang Hui
95http://www.youtube.com/watch?v=mrFDGct4kH8
![Page 96: CEE598 -Visual Sensing for Civil Infrastructure Eng. & Mgmt. - University … · 2014-02-02 · University of Illinois, Prof. Silvio Savarese, University of Michigan and ... first](https://reader034.fdocuments.in/reader034/viewer/2022042808/5f848c2bbb3938577c5e87aa/html5/thumbnails/96.jpg)
How to calibrate a camera?
Next lecture
CEE598 Visual Sensing for Civil Infrastructure Eng. & Mgmt. © Mani Golparvar-Fard, 2014
96