ifsr_Preprocessing

22
Image Registration:   Arthur Goshtasby Wright State University Image Registration and Fusion Systems

Transcript of ifsr_Preprocessing

Page 1: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 1/22

Image Registration: 

 Arthur Goshtasby

Wright State University

Image Registration and Fusion Systems

Page 2: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 2/22

 

improve the registration performance. These

 – Noise filtering

 – 

 – Region extraction

  – ge e ec on

A. Goshtasby 2

Page 3: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 3/22

Noise smoothing

Given image f(x,y) and smoothing filter h(i,j), noise

smoothing is defined by:

The intensity of pixel (x,y) in the output is obtained

from a weighted sum of intensities of pixels at and

around (x,y) in the input. h(i,j) is the weight of pixel(x+i,y+j) in the neighborhood of (x,y), and the sum of 

A. Goshtasby 3

.

Page 4: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 4/22

 • When the weights defined by the filter are all the same, the

.

• Intensities of all pixels at and around a point in input have the sameeffect on the intensity at the same point in output.

• This operation is not rotationally invariant if the filter kernel is not

circular.

Image containing Filter-radius 2 pixels Filter-radius 4 pixels

A. Goshtasby 4

Zero-mean noise Computed using FFT algorithm

Page 5: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 5/22

 

• If the wei hts in filter kernel re resent

Gaussian coefficients, a Gaussian filter isobtained.

• Gaussian filtering is effective when image noise is

zero-mean.• Gaussian filtering is rotationally invariant.

• A 2-D Gaussian can be decomposed into 2 1-D

auss ans:   x,y = x y; ere ore, er ngcan be carried in 1-D rather than in 2-D

A. Goshtasby 5

Page 6: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 6/22

Computation of mean and

aussian iltering

Although filtering is a convolution operation and can be computed using

the FFT algorithm, since FFT considers an image is a periodic signal, if left

and right image borders, or top and bottom image borders are not the same,

artifacts will appear near the image borders. To avoid this, carry out the

computations directly.

Image containing Computed with FFT Computed directly

A. Goshtasby 6

Zero-mean noise Gaussian filter of σ = 2 pixels

Page 7: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 7/22

 

into meaningful parts. There are two main.

 – Methods that use information within regions

 – 

 between regions

A. Goshtasby 7

Page 8: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 8/22

 

• Assuming an image that contains objects with intensities thatrepresent a auss an str ut on an a ac groun w tintensities that represent a different Gaussian distribution, theobjects can be separated from the background using the

.

• This method works well when an image contains

homogeneous objects and a homogeneous background and the.

Threshold

value

A. Goshtasby 8

Original Smoothed Histogram Thresholded image

Page 9: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 9/22

Intensity thresholding

Threshold

value

A Landsat image Histogram of the image

Thresholding at the Thresholding at the

A. Goshtasby 9

valley between the average intensity of 

first two peaks. highest-gradient pixels.

Page 10: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 10/22

 

 – Finding the valley between the modes of the

.

 – Finding the intensity that represents the average of 

intensities of hi h- radient ixels. 

 – Finding the intensity at which a change in the

intensit will minimall chan e the se mentation

result.

A. Goshtasby 10

Page 11: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 11/22

 

Delineated tumor 

Data courtesy of Kettering Medical Center 

A. Goshtasby 11

,

Page 12: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 12/22

 

• Ed e detection methods can be cate orized into those

that search for locally maximum image gradientmagnitudes and those that search for zero-crossingso e ap ac an o an mage.

• Methods that search for gradient peaks do not pick 

disconnected.

• Methods that search of the zero-crossings of the

Laplacian image find closed boundaries, but parts of the boundaries could be false.

A. Goshtasby 12

Page 13: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 13/22

 

involves computation of:

or,

A. Goshtasby 13

Page 14: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 14/22

An x-ray angiogram LoG zero-crossing edges

A. Goshtasby 14

Page 15: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 15/22

A volumetric MR brain image LoG edges

A. Goshtasby 15

Data courtesy of Kettering Medical Center 

Page 16: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 16/22

 • Zero-crossing edges can be

eterm ne y convo v ng

the negative and positive parts of the LoG with an

operator in

2-D

 subtracting the convolved

images and locating the zero-crossin s.

• If instead of subtractingcorresponding values in theconvolved ima es, we divide

 part

the values and locate theone-crossings, intensity-ratioedges will be obtained.

 

 part

A. Goshtasby 16

Page 17: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 17/22

 

(a) Intensity ratio edges. (b) 30% highest-gradient ratio

edges. (c) Intensity difference edges. (d) 30% highest-

gradient difference edges.

Intensity ratios detect more edges in dark areas

while intensity differences detect more edges

A. Goshtasby 17(d)

.

Page 18: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 18/22

 

• This method smoothes the ima e with a Gaussian to reduce

noise and then locates locally maximum gradient magnitudesin the gradient direction and uses them as the edges.

An x-ra an io ram Cann ed es with σ = 2.5 ixels

A. Goshtasby 18

 

Page 19: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 19/22

Edges in color images

• Edge detection in a color image can be considered edge- .

• If u(x,y) and v(x,y) represent color gradients in x and ydirections, edges can be considered points where color .

• If  R(x,y), G(x,y), and B(x,y) represent red, green, and bluecolor components at (x,y), respectively, color gradients are:

r, g, and b are unit vectors along red, green, and blue axes,

A. Goshtasby 19

respectively, in the color space.

Page 20: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 20/22

Color edges

•  ,  

maximizing

and is obtained from

A. Goshtasby 20

Page 21: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 21/22

ge e ec on n co or mages

A color image Edges of the color image

A. Goshtasby 21

Page 22: ifsr_Preprocessing

8/3/2019 ifsr_Preprocessing

http://slidepdf.com/reader/full/ifsrpreprocessing 22/22

 1. D. Marr and E. Hildreth, Theory of edge detection, Proc. R. Soc. Lond .,

 – .

2. J. J. Clark, Authenticating edges produced by zero-crossing algorithms, IEEE Trans. Pattern Analysis and Machine Intelligence, 11(1):43–57 (1989).

3. J. Canny, A computational approach to edge detection, IEEE Trans. Pattern, – .

4. L. Ding and A. Goshtasby, On the Canny edge detector, Pattern Recognition,34:721–725 (2001).

5. M. Bomans, K.-H. Hohne, U. Tiede, and M. Riemer, 3-D segmentation of MR - , ransac ons on e ca mag ng,

9(2):177–183 (1990).

6. A. Goshtasby and H-L Shu, Edge detection by curve fitting, Image and VisionComputing, 13(3): 169–177, 1995.

. . , , mage an s on ompu ng,  – ,1994.

8. L. Zagorchev, A. Goshtasby, and M. Satter, R-snakes, Image and VisionComputing, 25: 945–959, 2007.

A. Goshtasby 22