MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937)...
Transcript of MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937)...
![Page 1: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/1.jpg)
MEDICAL IMAGE COMPUTING (CAP 5937)
LECTURE 17: Medical Image Registration III (Advanced):FFD with B-Splines, Diffeomorphic Image Registration, and
Regularizations
Dr. Ulas BagciHEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL [email protected] or [email protected]
1SPRING 2016
![Page 2: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/2.jpg)
Outline• Deformable Image Registration
– B-spline parametrization and Free Form Deformation• Optimization • Diffeomorphic Image Registration
2
![Page 3: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/3.jpg)
Rigid Transformation
3
• Rotation• Translation• Scale 12 pRstp !"!! +=
⎥⎦
⎤⎢⎣
⎡ −=)cos()sin(
)sin()cos(
θθθθ
R
⎥⎦
⎤⎢⎣
⎡=
2
22 y
xp!⎥
⎦
⎤⎢⎣
⎡=
1
11 y
xp! ⎥
⎦
⎤⎢⎣
⎡=
2
11 s
ss! ⎥
⎦
⎤⎢⎣
⎡=
2
11 t
tt!
![Page 4: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/4.jpg)
Rigid Transformation
4
![Page 5: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/5.jpg)
Affine Transformation
5
• Rotation• Translation• Scale• Shear
– No more preservation of lengths and angles– Parallel lines are preserved
⎥⎦
⎤⎢⎣
⎡⎥⎦
⎤⎢⎣
⎡++
+⎥⎦
⎤⎢⎣
⎡=⎥
⎦
⎤⎢⎣
⎡
1
1
2221
1211
23
13
2
2
yx
aaaa
aa
yx
![Page 6: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/6.jpg)
Non-Rigid Deformation
6
Source
Target
Before
After
![Page 7: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/7.jpg)
Deformation Fields
7
y
x
![Page 8: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/8.jpg)
Deformation Fields
8
y
x
![Page 9: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/9.jpg)
Free Form Deformation
9
Credits: Sederberg and Parry, SIGGRAPH (1986)
![Page 10: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/10.jpg)
Global Motion Model
10
(12 degrees of freedom)
![Page 11: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/11.jpg)
Local Motion Model• The affine transformation captures only the global motion.• An additional transformation is required, which models the
local deformation
11
![Page 12: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/12.jpg)
Local Motion Model• The affine transformation captures only the global motion.• An additional transformation is required, which models the
local deformation
12
![Page 13: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/13.jpg)
FFD with B-Splines
13
![Page 14: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/14.jpg)
B-Spline / Math
14
![Page 15: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/15.jpg)
15
![Page 16: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/16.jpg)
Deformation with B-Splines
16
Original Lena
![Page 17: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/17.jpg)
Deformation with B-Splines
17
Deformed with B-Spline - Lena
![Page 18: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/18.jpg)
B-Spline Parametrization
18
![Page 19: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/19.jpg)
B-Splines Practically
19
![Page 20: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/20.jpg)
B-Splines Practically
20
![Page 21: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/21.jpg)
Optimization
21
![Page 22: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/22.jpg)
Math-Defn.
22
![Page 23: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/23.jpg)
Iterative Optimization
23
![Page 24: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/24.jpg)
Gradient Descent
24
![Page 25: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/25.jpg)
Cost Function Derivative
25
![Page 26: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/26.jpg)
26
![Page 27: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/27.jpg)
27
![Page 28: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/28.jpg)
28
![Page 29: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/29.jpg)
29
![Page 30: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/30.jpg)
Diffeomorphic Image Registration• At its simplest, image registration involves estimating a
smooth, continuous mapping between the points in one image and those in another.
30
![Page 31: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/31.jpg)
Diffeomorphic Image Registration• At its simplest, image registration involves estimating a
smooth, continuous mapping between the points in one image and those in another.
• The relative shapes of the images can then be determined from the parameters that encode the mapping.
31
![Page 32: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/32.jpg)
Diffeomorphic Image Registration• At its simplest, image registration involves estimating a
smooth, continuous mapping between the points in one image and those in another.
• The relative shapes of the images can then be determined from the parameters that encode the mapping.
• The objective is usually to determine the single “best” set of values for these parameters
32
![Page 33: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/33.jpg)
Diffeomorphic Image Registration• At its simplest, image registration involves estimating a
smooth, continuous mapping between the points in one image and those in another.
• The relative shapes of the images can then be determined from the parameters that encode the mapping.
• The objective is usually to determine the single “best” set of values for these parameters– The small-deformation framework does not necessarily preserve
topology—although if the deformations are relatively small, then it may still be preserved.
– The large-deformation framework generates deformations (diffeomorphisms) that have a number of elegant mathematical properties, such as enforcing the preservation of topology.
33
![Page 34: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/34.jpg)
Deformation Model• Many registration algorithm still use small displacement
models (u), which is simply added into identity transform (x):
34
![Page 35: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/35.jpg)
Deformation Model• Many registration algorithm still use small displacement
models (u), which is simply added into identity transform (x):
• In such parameterizations, the inverse transformation is sometimes approximated by subtracting the displacement. It is worth noting that this is only a very approximate inverse, which fails badly for larger deformations.
35
![Page 36: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/36.jpg)
Deformation Model
36
Small deformation models do not necessarily enforce a one-to-one mapping.
If the inverse transformation is correct,these two should be identity!
![Page 37: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/37.jpg)
Diffeomorphic Registration• The large-deformation or diffeomorphic setting is a much
more elegant framework. A diffeomorphism is a globally one-to-one (objective) smooth and continuous mapping with derivatives that are invertible.
37
![Page 38: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/38.jpg)
Diffeomorphic Registration• The large-deformation or diffeomorphic setting is a much
more elegant framework. A diffeomorphism is a globally one-to-one (objective) smooth and continuous mapping with derivatives that are invertible.
• If the mapping is not diffeomorphic, then topology is not necessarily preserved.
38
![Page 39: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/39.jpg)
Diffeomorphic Registration• The large-deformation or diffeomorphic setting is a much
more elegant framework. A diffeomorphism is a globally one-to-one (objective) smooth and continuous mapping with derivatives that are invertible.
• If the mapping is not diffeomorphic, then topology is not necessarily preserved.
• it is easier to parameterize using a number of velocity fields corresponding to different time periods over the course of the evolution of the diffeomorphism (consider u(t) as a velocity field at time t
39
![Page 40: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/40.jpg)
Diffeomorphic Registration• The large-deformation or diffeomorphic setting is a much
more elegant framework. A diffeomorphism is a globally one-to-one (objective) smooth and continuous mapping with derivatives that are invertible.
• If the mapping is not diffeomorphic, then topology is not necessarily preserved.
• it is easier to parameterize using a number of velocity fields corresponding to different time periods over the course of the evolution of the diffeomorphism (consider u(t) as a velocity field at time t
• Diffeomorphisms are generated by initializing with an identity transform and integrating over unit time to obtain
40
![Page 41: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/41.jpg)
Forward & Inverse Transform
41
![Page 42: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/42.jpg)
DARTEL: A Fast Diffeomorphic Method (Ashburner, NeuroImage 2007)
DiffeomorphicAnatomicalRegistrationThroughExponentiatedLie Algebra
42
![Page 43: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/43.jpg)
DARTEL: A Fast Diffeomorphic Method (Ashburner, NeuroImage 2007)
• The DARTEL model assumes a flow field (u) that remains constant over time. With this model, the differential equation describing the evolution of a deformation is
43
![Page 44: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/44.jpg)
DARTEL: A Fast Diffeomorphic Method (Ashburner, NeuroImage 2007)
• The DARTEL model assumes a flow field (u) that remains constant over time. With this model, the differential equation describing the evolution of a deformation is
• The Euler method is a simple integration approach to extend from identity (initial) transform, which involves computing new solutions after many successive small time-steps (h).
44
![Page 45: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/45.jpg)
DARTEL: A Fast Diffeomorphic Method (Ashburner, NeuroImage 2007)
• The DARTEL model assumes a flow field (u) that remains constant over time. With this model, the differential equation describing the evolution of a deformation is
• The Euler method is a simple integration approach to extend from identity (initial) transform, which involves computing new solutions after many successive small time-steps (h).
• Each of these Euler steps is equivalent to
45
![Page 46: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/46.jpg)
DARTEL: A Fast Diffeomorphic Method (Ashburner, NeuroImage 2007)
• The use of a large number of small time steps will produce a more accurate solution, for instance (8 steps)
46
![Page 47: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/47.jpg)
Optimization of DARTEL• Image registration procedures use a mathematical model to
explain the data. Such a model will contain a number of unknown parameters that describe how an image is deformed.
47
![Page 48: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/48.jpg)
Optimization of DARTEL• Image registration procedures use a mathematical model to
explain the data. Such a model will contain a number of unknown parameters that describe how an image is deformed.
• A true diffeomorphism has an infinite number of dimensions and is infinitely differential.
48
![Page 49: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/49.jpg)
Optimization of DARTEL• Image registration procedures use a mathematical model to
explain the data. Such a model will contain a number of unknown parameters that describe how an image is deformed.
• A true diffeomorphism has an infinite number of dimensions and is infinitely differential.
• The discrete parameterization of the velocity field, u(x), can be considered as a linear combination of basis functions.
49
ρi(x) is the ith first degree B-spline basis function at position x
v is a vector of coefficients
![Page 50: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/50.jpg)
Optimization of DARTEL• The aim is to estimate the single “best” set of values for these
parameters (v). The objective function, which is the measure of “goodness”, is formulated as the most probable deformation, given the data (D).
50
![Page 51: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/51.jpg)
Optimization of DARTEL• The aim is to estimate the single “best” set of values for these
parameters (v). The objective function, which is the measure of “goodness”, is formulated as the most probable deformation, given the data (D).
• The objective is to find the most probable parameter values and not the actual probability density, so this factor is ignored. The single most probable estimate of the parameters is known as the maximum a posteriori (MAP) estimate.
51
![Page 52: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/52.jpg)
Optimization of DARTEL• The aim is to estimate the single “best” set of values for these
parameters (v). The objective function, which is the measure of “goodness”, is formulated as the most probable deformation, given the data (D).
• The objective is to find the most probable parameter values and not the actual probability density, so this factor is ignored. The single most probable estimate of the parameters is known as the maximum a posteriori (MAP) estimate.
Or
52
![Page 53: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/53.jpg)
Optimization of DARTEL• Many nonlinear registration approaches search for a
maximum a posteriori (MAP) estimate of the parameters defining the warps, which corresponds to the mode of the probability density
53
![Page 54: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/54.jpg)
Optimization of DARTEL• Many nonlinear registration approaches search for a
maximum a posteriori (MAP) estimate of the parameters defining the warps, which corresponds to the mode of the probability density
• The Levenberg–Marquardt (LM) algorithm is a very good general purpose optimization strategy
54
![Page 55: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/55.jpg)
Optimization of DARTEL• Many nonlinear registration approaches search for a
maximum a posteriori (MAP) estimate of the parameters defining the warps, which corresponds to the mode of the probability density
• The Levenberg–Marquardt (LM) algorithm is a very good general purpose optimization strategy
55
A: second order tensor field, H: concentration matrix, b: first derivative of likelihood func.
![Page 56: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/56.jpg)
Optimization of DARTELSimultaneously minimize the sum of
– Likelihood component• Sum of squares difference
• ½ ∑i∑k(tk(xi) – μk(φ(1)(xi)))2
• φ(1) parameterized by u– Prior component
• A measure of deformation roughness
• ½uTHu
56
![Page 57: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/57.jpg)
Optimization of DARTELPRIOR TERM• ½uTHu• DARTEL has three different models for H
– Membrane energy– Linear elasticity– Bending energy
• H is very sparse• H: deformation roughness
57
An example H for 2D registration of 6x6 images (linear elasticity)
![Page 58: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/58.jpg)
Optimization of DARTEL
LIKELIHOOD TERM• Images assumed to be partitioned into different tissue
classes.– E.g., a 3 class registration simultaneously matches:
• Grey matter with grey matter• White matter wit white matter• Background (1 – GM – WM) with background
58
![Page 59: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/59.jpg)
“Membrane Energy”
Convolution KernelSparse Matrix Representation
Penalizes first derivatives.Sum of squares of the elements of the Jacobian (matrices) of the flow field.
![Page 60: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/60.jpg)
“Bending Energy”
Sparse Matrix Representation Convolution Kernel
Penalizes second derivatives.
![Page 61: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/61.jpg)
“Linear Elasticity”• Decompose the Jacobian of the flow field into
– Symmetric component• ½(J+JT)• Encodes non-rigid part.
– Anti-symmetric component• ½(J-JT)• Encodes rigid-body part.
• Penalise sum of squaresof symmetric part.
• Trace of Jacobianencodes volume changes.Also penalized.
![Page 62: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/62.jpg)
Gauss-Newton Optimization• Uses Gauss-Newton
– Requires a matrix solution to a very large set of equations at each iteration
u(k+1) = u(k) - (H+A)-1 b
– b are the first derivatives of objective function– A is a sparse matrix of second derivatives– Computed efficiently, making use of scaling and squaring
62
![Page 63: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/63.jpg)
Summary• Deformable Image Registration
– B-spline parametrization and Free Form Deformation• Optimization • Diffeomorphic Image Registration
63
![Page 64: MEDICAL IMAGE COMPUTING (CAP 5937)bagci/teaching/mic16/lec17.pdfMEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 17: Medical Image Registration III (Advanced): FFD with B-Splines, Diffeomorphic](https://reader033.fdocuments.in/reader033/viewer/2022042216/5ebfb862e4fab04b41350526/html5/thumbnails/64.jpg)
Slide Credits and References• Darko Zikic, MICCAI 2010 Tutorial• Stefan Klein, MICCAI 2010 Tutorial• Marius Staring, MICCAI 2010 Tutorial• J. Ashburner, NeuroImage 2007.• M. F. Beg, M. I. Miller, A. Trouvé and L. Younes. “Computing
Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms”. International Journal of Computer Vision 61(2):139–157 (2005).
• M. Vaillant, M. I. Miller, L. Younes and A. Trouvé. “Statistics on diffeomorphisms via tangent space representations”. NeuroImage 23:S161–S169 (2004).
• L. Younes, “Jacobi fields in groups of diffeomorphisms and applications”. Quart. Appl. Math. 65:113–134 (2007).
64