Lecture 4: Image Resampling CS4670: Computer Vision Noah Snavely.
Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl...
Transcript of Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl...
![Page 1: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/1.jpg)
Computer Vision: Lecture 9
Carl Olsson
2013-02-20
Carl Olsson Computer Vision: Lecture 9 2013-02-20 1 / 21
![Page 2: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/2.jpg)
Todays Lecture
Reconstruction and Optimization
Objective Function: Reconstruction Error
Principles of Local Optimization
Least Squares Optimization
Non-Linear Least Squares
Carl Olsson Computer Vision: Lecture 9 2013-02-20 2 / 21
![Page 3: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/3.jpg)
Minimizing Reprojection Error
Under the assumption that image points are corrupted by Gaussian noise,minimize the reprojection error.
The reprojection error
In regular coordinates(x = (x , y)) the projection is(
P1X
P3X,P2X
P3X
),
P1,P2,P3 are the rows of P.The reprojection error is
||(x − P1X
P3X, y − P2X
P3X
)||2.
C
x
PX
X
Carl Olsson Computer Vision: Lecture 9 2013-02-20 3 / 21
![Page 4: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/4.jpg)
Minimizing Reprojection Error
Calibrated Structure and Motion
Given image projections {(xij , yij)} (i = point nr, j = image nr), find 3Dpoints Xi and cameras Pj =
[Rj tj
]such that
∑ij
||
(xij −
P1j Xi
P3j Xi
, yij −P2j Xi
P3j Xi
)||2,
is minimized.
Complicated non linear expression.
No closed form solution.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 4 / 21
![Page 5: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/5.jpg)
Minimizing Reprojection Error, Locally
Pick a starting point.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 5 / 21
![Page 6: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/6.jpg)
Minimizing Reprojection Error, Locally
Approximate the function using 2nd order Taylor expansion andminimize.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 6 / 21
![Page 7: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/7.jpg)
Minimizing Reprojection Error, Locally
Repeat.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 7 / 21
![Page 8: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/8.jpg)
Minimizing Reprojection Error, Locally
Newtons method.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 8 / 21
![Page 9: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/9.jpg)
Minimizing Reprojection Error, Locally
Different starting point.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 9 / 21
![Page 10: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/10.jpg)
Minimizing Reprojection Error, Locally
Different starting point.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 10 / 21
![Page 11: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/11.jpg)
Minimizing Reprojection Error, Locally
Leads to local minimum.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 11 / 21
![Page 12: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/12.jpg)
Minimizing Reprojection Error, Locally
Third starting point, leads to local maximum.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 12 / 21
![Page 13: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/13.jpg)
Minimizing Reprojection Error, Locally
Why not just sample the function?One dimensional function:
Carl Olsson Computer Vision: Lecture 9 2013-02-20 13 / 21
![Page 14: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/14.jpg)
Minimizing Reprojection Error, Locally
Why not just sample the function?One dimensional function:
Sample 10 points, pick lowest value. Probably works.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 14 / 21
![Page 15: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/15.jpg)
Minimizing Reprojection Error, Locally
Why not just sample the function?Two dimensional function:
102 samples.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 15 / 21
![Page 16: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/16.jpg)
Minimizing Reprojection Error, Locally
Why not just sample the function?Three dimensional function:
103 samples.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 16 / 21
![Page 17: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/17.jpg)
Minimizing Reprojection Error, Locally
How many variables do we have?
The cathedral dataset:
480 camera matrices [Ri ti ].Rotation part 3 dof, translationpart 3 dof.Totally: 480(3 + 3) = 2880.
91178 3D points.3 dof each.Totally: 91178 · 3 = 273534
Carl Olsson Computer Vision: Lecture 9 2013-02-20 17 / 21
![Page 18: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/18.jpg)
Local Optimization
See lecture notes.
Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21
![Page 19: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/19.jpg)
Steepest Descent
See lecture notes.Demonstration...
Carl Olsson Computer Vision: Lecture 9 2013-02-20 19 / 21
![Page 20: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/20.jpg)
Gauss-Newton
See lecture notes.Demonstration...
Carl Olsson Computer Vision: Lecture 9 2013-02-20 20 / 21
![Page 21: Computer Vision: Lecture 9 - LTH · 2013-02-18 · Local Optimization See lecture notes. Carl Olsson Computer Vision: Lecture 9 2013-02-20 18 / 21](https://reader030.fdocuments.in/reader030/viewer/2022040914/5e8c25240c350657b571cdfa/html5/thumbnails/21.jpg)
Levenberg-Marquard
See lecture notes.Demonstration...
Carl Olsson Computer Vision: Lecture 9 2013-02-20 21 / 21