CS 691B Computational Photography Instructor: Gianfranco Doretto Image Warping.
-
Upload
janice-phelps -
Category
Documents
-
view
213 -
download
0
Transcript of CS 691B Computational Photography Instructor: Gianfranco Doretto Image Warping.
CS 691B Computational Photography
Instructor: Gianfranco DorettoImage Warping
Image Transformations
Image Filtering: change range of imageg(x) = T(f(x))
f
x
Tf
x
f
x
Tf
x
Image Warping: change domain of imageg(x) = f(T(x))
Image Transformations
T
T
f
f g
g
Image Filtering: change range of imageg(x) = T(f(x))
Image Warping: change domain of imageg(x) = f(T(x))
Parametric (global) warping
Examples of parametric warps:
translation rotation aspect
affineperspective
cylindrical
Parametric (global) warping
Transformation T is a coordinate-changing machine:p’ = T(p)
What does it mean that T is global?Is the same for any point pcan be described by just a few numbers (parameters)
Let’s represent T as a matrix: p’ = Mp
T
p = (x,y) p’ = (x’,y’)
Scaling• Scaling a coordinate means multiplying each of its
components by a scalar• Uniform scaling means this scalar is the same for all
components:
x 2
• Non-uniform scaling: different scalars per component:•
Scaling
X x 2,Y x 0.5
Scaling
Scaling operation:
Or, in matrix form:
byy
axx
'
'
y
x
b
a
y
x
0
0
'
'
scaling matrix S
What’s inverse of S?
2-D Rotation
θ
(x, y)
(x’, y’)
x’ = x cos(θ) - y sin(θ)y’ = x sin(θ) + y cos(θ)
2-D Rotation
x = r cos (ϕ)y = r sin (ϕ)x’ = r cos (ϕ + θ)y’ = r sin (ϕ + θ)
Trig Identity…x’ = r cos(ϕ) cos(θ) – r sin(ϕ) sin(θ)y’ = r sin(ϕ) cos(θ) + r cos(ϕ) sin(θ)
Substitute…x’ = x cos(θ) - y sin(θ)y’ = x sin(θ) + y cos(θ)θ
(x, y)
(x’, y’)
ϕ
2-D Rotation•This is easy to capture in matrix form:
•Even though sin(θ) and cos(θ) are nonlinear functions of θ,– x’ is a linear combination of x and y– y’ is a linear combination of x and y
•What is the inverse transformation?– Rotation by –θ– For rotation matrices
y
x
y
x
cossin
sincos
'
'
TRR 1
R
2x2 Matrices
What types of transformations can be represented with a 2x2 matrix?
2D Identity?
yyxx
''
yx
yx
1001
''
2D Scale around (0,0)?
ysy
xsx
y
x
*'
*'
y
x
s
s
y
x
y
x
0
0
'
'
2x2 Matrices
What types of transformations can be represented with a 2x2 matrix?
2D Rotate around (0,0)?
yxyyxx
*cos*sin'*sin*cos'
y
x
y
x
cossin
sincos
'
'
2D Shear?
yxshy
yshxx
y
x
*'
*'
y
x
sh
sh
y
x
y
x
1
1
'
'
2x2 Matrices
What types of transformations can be represented with a 2x2 matrix?
2D Mirror about Y axis?
yyxx
''
yx
yx
1001
''
2D Mirror over (0,0)?
yyxx
''
yx
yx
1001
''
2x2 Matrices
What types of transformations can be represented with a 2x2 matrix?
2D Translation?
y
x
tyy
txx
'
'
Only linear 2D transformations can be represented with a 2x2 matrix
NO!
All 2D Linear Transformations
• Linear transformations are combinations of …– Scale,– Rotation,– Shear, and– Mirror
• Properties of linear transformations:– Origin maps to origin– Lines map to lines– Parallel lines remain parallel– Ratios are preserved– Closed under composition
y
x
dc
ba
y
x
'
'
yx
lkji
hgfe
dcba
yx
''
Consider a different Basisv =(vi,vj)
u=(ui,uj)
puv
j =(0,1)
i =(1,0)
pij
pij=5i+4j = (5,4) puv = 4u+3v = (4,3)
Linear Transformations as Change of Basis
Any linear transformation is a change of basis!!!
j =(0,1)
i =(1,0)
pij = 4u+3v = (pi,pj) ?
pi = 4ui+3vi
pj = 4uj+3vj
v =(vi,vj)
u=(ui,uj)
puv pij
puv = (4,3)
puvpij ==jj
ii
jj
ii
vuvu
vuvu
34
What’s the inverse transform?
• How can we change from any basis to any basis?• What if the basis are orthonormal? And orthogonal?
v =(vi,vj)
u=(ui,uj)
puv
j =(0,1)
i =(1,0)
pij = (5,4)
pij
puv = (pu,pv) = ?= puu + pvv
pijpuv ==jj
ii
jj
ii
vuvu
vuvu
45
-1-1
Projection onto orthonormal basisv =(vi,vj)
u=(ui,uj)
puv
j =(0,1)
i =(1,0)
pij = (5,4)
pij
puv = (u·pij, v·pij)
pijpuv ==ji
ji
ji
ji
vvuu
vvuu
45
NOTE: The inverse is just the transpose!
Homogeneous Coordinates
• Q: How can we represent translation as a 3x3 matrix?
y
x
tyy
txx
'
'
Homogeneous Coordinates
Represent coordinates in 2 dimensions with a 3-vector
1
coords shomogeneou y
x
y
x
Homogeneous Coordinates• Add a 3rd coordinate to every 2D point
– (x, y, w) represents a point at location (x/w, y/w)
– (x, y, 0) represents a point at infinity or a vector
– (0, 0, 0) is not allowed
Convenient coordinate system to represent many useful transformations
1 2
1
2(2,1,1) or (4,2,2) or (6,3,3)
x
y
Homogeneous Coordinates
• Q: How can we represent translation as a 3x3 matrix?
• A: Using the rightmost column:
100
10
01
y
x
t
t
ranslationT
y
x
tyy
txx
'
'
Translation
Example of translation
11100
10
01
1
'
'
y
x
y
x
ty
tx
y
x
t
t
y
x
tx = 2ty = 1
Homogeneous Coordinates
Basic 2D Transformations
Basic 2D transformations as 3x3 matrices
1100
0cossin
0sincos
1
'
'
y
x
y
x
1100
10
01
1
'
'
y
x
t
t
y
x
y
x
1100
01
01
1
'
'
y
x
sh
sh
y
x
y
x
Translate
Rotate Shear
1100
00
00
1
'
'
y
x
s
s
y
x
y
x
Scale
Matrix Composition
Transformations can be combined by matrix multiplication
wyx
sysx
tytx
wyx
1000000
1000cossin0sincos
1001001
'''
p’ = T(tx,ty) R(Q) S(sx,sy) p
Does the order of multiplication matter?
Affine Transformations
• Affine transformations are combinations of …– Linear transformations, and– Translations
• Properties of affine transformations:– Origin does not necessarily map to origin– Lines map to lines– Parallel lines remain parallel– Ratios are preserved– Closed under composition– Model change of basis
• Will the last coordinate w always be 1?
wyx
fedcba
wyx
100''
Projective Transformations
• Projective transformations …– Affine transformations, and– Projective warps
• Properties of projective transformations:– Origin does not necessarily map to origin– Lines map to lines– Parallel lines do not necessarily remain parallel– Ratios are not preserved– Closed under composition– Models change of basis
wyx
ihgfedcba
wyx
'''
2D image transformations
These transformations are a nested set of groups• Closed under composition and inverse is a member
Recovering Transformations
• What if we know f and g and want to recover the transform T?– willing to let user provide
correspondences• How many do we need?
x x’
T(x,y)y y’
f(x,y) g(x’,y’)
?
Translation: # correspondences?
• How many Degrees of Freedom?• How many correspondences needed for translation?• What is the transformation matrix?
x x’
T(x,y)y y’
?
100
'10
'01
yy
xx
pp
pp
M
Euclidian: # correspondences?
• How many DOF?• How many correspondences needed for
translation+rotation?
x x’
T(x,y)y y’
?
Affine: # correspondences?
• How many DOF?• How many correspondences needed
for affine?
x x’
T(x,y)y y’
?
Projective: # correspondences?
• How many DOF?• How many correspondences needed for
projective?
x x’
T(x,y)y y’
?
Slide Credits
• This set of sides also contains contributionskindly made available by the following authors– Alexei Efros– Richard Szelisky