Lec3: Pre-Processing Medical Images
-
Upload
ulas-bagci -
Category
Science
-
view
13 -
download
8
Transcript of Lec3: Pre-Processing Medical Images
![Page 1: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/1.jpg)
MEDICAL IMAGE COMPUTING (CAP 5937)
LECTURE 3: Pre-Processing Medical Images (I)
Dr. Ulas BagciHEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL [email protected] or [email protected]
1SPRING 2017
![Page 2: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/2.jpg)
Outline• CAVA: Computer Aided Visualization and Analysis• CAD: Computer Aided Diagnosis• Definitions and Terminologies• Coordinate Systems• Pre-Processing Images
– Volume of Interest– Region of Interest– Intensity of Interest– Image Enhancement
• Filtering• Smoothing
2
![Page 3: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/3.jpg)
CAVA: Computer Aided Visualization and Analysis
• Definition:– The science of underlying computerized methods
of image processing, analysis, and visualizations to facilitate new therapeutic strategies, basic clinical research, education, and training.
3
![Page 4: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/4.jpg)
CAD: Computer Aided Diagnosis
• Definition:– The science of underlying computerized methods
of image processing, analysis for the diagnosis of diseases via images.
4
![Page 5: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/5.jpg)
Purpose of CAVA and CAD
5
CAVA/CADMultiple multimodalityMultidimensional imagesOf an object system
Qualitative/QuantitativeInformation of the objectsIn the object system
Object System: a collection of rigid, deformable, static, or dynamic objects inside the body ofor conceptual objects.
![Page 6: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/6.jpg)
CAVA/CAD Operations• Pre (Image) Processing
– For enhancing information about and defining object system.
• Visualization– For viewing and comprehending object system
• Manipulation– For altering object system (virtual surgery)
• Analysis– For quantifying information about object system.
6
![Page 7: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/7.jpg)
CAVA/CAD Operations• Pre (Image) Processing
– For enhancing information about and defining object system.
• Visualization– For viewing and comprehending object system
• Manipulation– For altering object system (virtual surgery)
• Analysis– For quantifying information about object system.
7
Today’s lecture
![Page 8: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/8.jpg)
Terminology-I• Object:
– An entity that is imaged and studied. May be rigid, deformable, static, or dynamic, physical or conceptual.
• Object system:– A collection of related objects.
• Scanner:– Any imaging device-real or conceptual.
• Body region:– The support region of the imaged object system.
• Voxels (3D):– Cuboidal elements into which body region is digitized by the imaging
device.
8
![Page 9: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/9.jpg)
Terminology-II• Scene:
– Multidimensional (2D, 3D, 4D, …) image of the body regions; S=(C,f)• Scene Domain:
– Rectangular array of voxels on which scene is defined; C• Scene Intensity:
– Values assigned to voxels; f(c)• Binary Scene:
– A scene with intensities 0 and 1 only.• Structure:
– Geometric representation of an object in the object system derived from scenes.
9
![Page 10: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/10.jpg)
Terminology-III• Structure System:
– A collection of structures representing the objects in an object system• Rendition:
– A 2D image depicting a structure system• Body Coordinate System:
– A coordinate system associated with the imaged body region• Scanner Coordinate System:
– A coordinate system affixed to the scanner• Scene Coordinate System:
– A coordinate system affixed to the scene• Structure Coordinate System:
– A coordinate system determined for structures• Display Coordinate System:
– A coordinate system associated with the display device
10
![Page 11: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/11.jpg)
11
abc: scanner coordinate system
xyz: scene coordinate system
uvw: structure coordinate system
rst: display coordinate system
αβγ : body coordinatesystem
s structure
voxel
y scene domain
z
xwu
v
r
a
b
t
c
pixel
α
β
γ
Coordinate Systems
![Page 12: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/12.jpg)
Image Pre-Processing• Volume of Interest (VOI):
– Purpose: to reduce data for speeding up CAVA operations.
12
![Page 13: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/13.jpg)
Image Pre-Processing• Volume of Interest (VOI):
– Purpose: to reduce data for speeding up CAVA operations.• Region of Interest (ROI):
– To specify a subset of the scene domain.
13
![Page 14: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/14.jpg)
Image Pre-Processing• Volume of Interest (VOI):
– Purpose: to reduce data for speeding up CAVA operations.• Region of Interest (ROI):
– To specify a subset of the scene domain.• Intensity of Interest (IOI):
– To specify a subset of the scene intensities.
14
![Page 15: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/15.jpg)
Image Pre-Processing• Volume of Interest (VOI):
– Purpose: to reduce data for speeding up CAVA operations.• Region of Interest (ROI):
– To specify a subset of the scene domain.• Intensity of Interest (IOI):
– To specify a subset of the scene intensities.
Storage requirement can be reduced by a factor of 2-10
15
![Page 16: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/16.jpg)
VOI / ROI (volume/region of interest)
16
![Page 17: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/17.jpg)
VOI / ROI (volume/region of interest)17
Kidney region
![Page 18: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/18.jpg)
Image FilteringScene à Scene
S=(C,f) à SF=(C,fF)
18
Purpose: To suppress unwanted (non-object) info.To enhance wanted (object) information.
Enhancive: For enhancing edges, regions.For intensity scale standardization.For correcting background variation.
Suppressive: Mainly for suppressing random noise.
![Page 19: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/19.jpg)
Medical Image Enhancement• Medical images are often deteriorated by noise due to various
sources of interference– affect measurement process in imaging and data acquisition systems
19
![Page 20: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/20.jpg)
Medical Image Enhancement• Medical images are often deteriorated by noise due to various
sources of interference– affect measurement process in imaging and data acquisition systems
• Improvement in appearance and visual quality of the images may assist in interpretation of medical images– may affect diagnostic decision too!
20
![Page 21: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/21.jpg)
Medical Image Enhancement• Medical images are often deteriorated by noise due to various
sources of interference– affect measurement process in imaging and data acquisition systems
• Improvement in appearance and visual quality of the images may assist in interpretation of medical images– may affect diagnostic decision too!
• Some enhancement algorithms are developed for deriving images that are meant for use by a subsequent algorithm for computer processing!– Edge detection, object segmentation, etc.
21
![Page 22: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/22.jpg)
Inappropriate use of Enhancement Methods
• Enhancement methods themselves may increase noise while improving contrast!
• They may eliminate small details and edge sharpness while removing noise
• They may produce artifacts in general.
22
![Page 23: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/23.jpg)
Smoothing MRI
23
Credit to:
![Page 24: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/24.jpg)
• Computers use discrete form of the images• The process of transforming continuous space into discrete
space is called digitization
24
Images Sampling+ Quantization
Digital Images
REMARKS
![Page 25: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/25.jpg)
• Definition: A (2D) image P is a function defined on a (finite) rectangular subset G of a regular planar orthogonal array. G is called (2D) grid, and an element of G is called pixel. P assigns a value of P(p) to each
25
p 2 G
REMARKS
![Page 26: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/26.jpg)
Histogram• Histogram of an image provides the frequency of the
brightness (intensity) value in the image.• Provides a natural bridge between images and a probabilistic
description.– Ex. Probability of pixel (x,y) that has a brightness (intensity) value zPseudo-Code for Histogram1. Create an array h with zero in its elements2. For all pixel locations (x,y) of the image A, increment h(A(x,y)) by 1
26
![Page 27: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/27.jpg)
27
![Page 28: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/28.jpg)
Ex: Histogram based analysis of Lung CT (credit: imbio)
28
![Page 29: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/29.jpg)
• Spatial resolution– determines the smallest structure that can be represented in a digital
image.
• Contrast resolution– Local change in brightness and defined as the ratio between average
brightness of an object and background – is an indirect measure of the perceptibility of structures. The number of
intensity levels has an influence on the likelihood with which two neighboring structures with similar but not equal appearance will be represented by different intensities.
29
![Page 30: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/30.jpg)
Another method for measuring contrast • RMS (root mean square) contrast:
The measure takes all pixels into account instead of just the pixels with maximum and minimum intensity values (M and N are size of the image, avg means mean operation over the entire image I).
30
![Page 31: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/31.jpg)
Image Artifacts• Noise
– MRI (ex: Gaussian, )– PET / SPECT (ex: Poisson, mixed Poisson-Gaussian)– CT (ex: Gaussian)– DTI, DWI, ...
• Intensity inhomogeneity– MRI
• Intensity Non-Standardness– MRI
• Partial Volume– MRI, PET,…
31
![Page 32: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/32.jpg)
Image Artifacts• Noise
– MRI (ex: Gaussian, )– PET / SPECT (ex: Poisson, mixed Poisson-Gaussian)– CT (ex: Gaussian)– DTI, DWI, ...
• Intensity inhomogeneity– MRI
• Intensity Non-Standardness– MRI
• Partial Volume– MRI, PET,…
32
![Page 33: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/33.jpg)
NoiseNoise is corrupting the image information, and it is unwanted.• Signal independent noise
– g = f + n• Gaussian
• Signal dependent noise– g = f*n
• Poisson
• Often, medical images are considered to have Gaussian noise, however PET/SPECT images have mixed Poisson/Gaussian, and MRI have Rician type noise.
33
![Page 34: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/34.jpg)
Noise Suppression
34
Higher noise, higher contrast Lower noise, lower contrast
For best results, we need lower noise and higher contrast.
![Page 35: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/35.jpg)
Linear Filtering• From linear system theory, we know that an image I(i,j) can
be written as follows (convolution)
35
![Page 36: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/36.jpg)
Linear Filtering• From linear system theory, we know that an image I(i,j) can
be written as follows (convolution)
• Practically, for a linear-shift invariant kernel f, convolution operation can be written as cross-correlation
36
![Page 37: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/37.jpg)
Convolution Operation
37
( ) ( )∑∑ −−=k l
lkhlkfhf ,,*
KernelImage
==
hf h7 h8 h9
h4 h5 h6
h1 h2 h3
h9 h8 h7
h6 h5 h4
h3 h2 h1
h1 h2 h3
h4 h5 h6
h7 h8 h9
hflipX −
flipY −
f1 f2 f3
f4 f5 f6
f7 f8 f9
∗
192837
465564
738291
*
hfhfhfhfhfhfhfhfhfhf
++++++++=
f
![Page 38: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/38.jpg)
Correlation Operation
38
( ) ( )∑∑=⊗k l
lkhlkfhf ,,
KernelImage
==
hf
h1 h2 h3
h4 h5 h6
h7 h8 h9
hf1 f2 f3
f4 f5 f6
f7 f8 f9
⊗
998877
665544
332211
hfhfhfhfhfhfhfhfhfhf
++++++++=⊗
f
![Page 39: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/39.jpg)
Correlation and Convolution
• Convolution is a filtering operation, expresses the amount of overlap of one function as it is shifted over another function
• Correlation compares the similarity of two sets of data (relatedness of the signals!)
39
![Page 40: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/40.jpg)
Noise suppression: Image Filtering
• Enhance or restore data by removing noise without significantly blurring the structures in the images.
40
![Page 41: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/41.jpg)
Noise suppression: Image Filtering
• Enhance or restore data by removing noise without significantly blurring the structures in the images.
• Literature is vast! We will cover only a few of them.
41
![Page 42: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/42.jpg)
Noise suppression: Image Filtering
• Enhance or restore data by removing noise without significantly blurring the structures in the images.
• Literature is vast! We will cover only a few of them.• Box (averaging/smoothing) Filtering:
42
![Page 43: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/43.jpg)
Noise suppression: Image Filtering
• Enhance or restore data by removing noise without significantly blurring the structures in the images.
• Literature is vast! We will cover only a few of them.• Gaussian Filtering:
43
![Page 44: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/44.jpg)
Noise suppression: Image Filtering
• Enhance or restore data by removing noise without significantly blurring the structures in the images.
• Literature is vast! We will cover only a few of them.• Gaussian Filtering:
44
![Page 45: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/45.jpg)
Noise suppression: Image Filtering
• Gaussian Filtering:
– fF is a Gaussian weighted average of f in a neighborhood of N of voxel v
45
![Page 46: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/46.jpg)
Remark: Why Gaussian Assumption?
• Most common natural model• Smooth function, it has infinite number of derivatives• It is Symmetric • Fourier Transform of Gaussian is Gaussian.• Convolution of a Gaussian with itself is a Gaussian.• Gaussian is separable; 2D convolution can be performed by
two 1-D convolutions• There are cells in eye that perform Gaussian filtering.
46
![Page 47: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/47.jpg)
Noise suppression: Image Filtering
• Enhance or restore data by removing noise without significantly blurring the structures in the images.
• Literature is vast! We will cover only a few of them.• Median Filtering:
– fF is median intensity in a neighborhood of voxel v.
47
![Page 48: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/48.jpg)
Median Filtering (Details)
48
[8 8 8 8 8 8 8 8 255]
median
![Page 49: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/49.jpg)
Filtering Operation (Spatial Domain)
49
111
111
111
],[g ⋅⋅Example: Box Filtering
(smoothing)What does it do?• Replaces each pixel with an
average of its neighborhood
• Achieve smoothing effect (remove sharp features)
![Page 50: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/50.jpg)
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
Credit: S. Seitz
],[],[],[,
lnkmflkgnmhlk
++=∑
[.,.]h[.,.]f111
111
111
],[g ⋅⋅Filtering Operation (Spatial Domain)
![Page 51: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/51.jpg)
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 10
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
[.,.]h[.,.]f111
111
111
],[g ⋅⋅
Credit: S. Seitz
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 52: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/52.jpg)
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 10 20
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
[.,.]h[.,.]f111
111
111
],[g ⋅⋅
Credit: S. Seitz
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 53: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/53.jpg)
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 10 20 30
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
[.,.]h[.,.]f111
111
111
],[g ⋅⋅
Credit: S. Seitz
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 54: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/54.jpg)
0 10 20 30 30
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
[.,.]h[.,.]f111
111
111
],[g ⋅⋅
Credit: S. Seitz
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 55: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/55.jpg)
0 10 20 30 30
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
[.,.]h[.,.]f111
111
111
],[g ⋅⋅
Credit: S. Seitz
?
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 56: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/56.jpg)
0 10 20 30 30
50
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
[.,.]h[.,.]f111
111
111
],[g ⋅⋅
Credit: S. Seitz
?
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 57: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/57.jpg)
0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 90 0 90 90 90 0 0
0 0 0 90 90 90 90 90 0 0
0 0 0 0 0 0 0 0 0 0
0 0 90 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0
0 10 20 30 30 30 20 10
0 20 40 60 60 60 40 20
0 30 60 90 90 90 60 30
0 30 50 80 80 90 60 30
0 30 50 80 80 90 60 30
0 20 30 50 50 60 40 20
10 20 30 30 30 30 20 10
10 10 10 0 0 0 0 0
[.,.]h[.,.]f111111111],[g ⋅⋅
Credit: S. Seitz
],[],[],[,
lnkmflkgnmhlk
++=∑
Filtering Operation (Spatial Domain)
![Page 58: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/58.jpg)
Filtering X-ray58
a. Radiography of the skull, b. low-pass filter with a Gaussian filter (std=15, 20 x 20), c. high-pass Filter obtained from subtracting b from a.
![Page 59: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/59.jpg)
Unsharp MaskingLower Noise, Higher Contrast
59
histogram histogram
![Page 60: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/60.jpg)
Unsharp Masking• Not only noise removal, but edge enhancement is necessary!
60
![Page 61: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/61.jpg)
Unsharp Masking• Not only noise removal, but edge enhancement is necessary!
61
Smoothed image(low pass)
Edge enhanced image(high pass)
![Page 62: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/62.jpg)
Unsharp Masking• Not only noise removal, but edge enhancement is necessary!
Reminder: Edges are located in high frequency of the images!
62
Smoothed image(low pass)
Edge enhanced image(high pass)
![Page 63: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/63.jpg)
Hand X-ray Unsharp Masking (alpha=0.5)
63
Original Image Enhanced Image
![Page 64: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/64.jpg)
Unsharp Masking: Example CT (head, axial)
64
Original CT Data Filtered CT Data
![Page 65: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/65.jpg)
Adaptive Filtering: Example head MRA
65
MIP of MRA data before filtering MIP of MRA data after filtering
![Page 66: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/66.jpg)
Adaptive Filtering: Example brain MRI
66
Original brain MRI Enhanced brain MRI
Note the improved contrast between brain and CSF (cerebrospinal fluid)
![Page 67: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/67.jpg)
Adaptive Filtering: Example brain MRI (zoomed)
67
Enhanced brain MRI
Note the improved contrast between brain and CSF (cerebrospinal fluid)
![Page 68: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/68.jpg)
Edges• Discontinuities in images are features that are often useful for
initializing an image analysis procedure.• Edges are important information for understanding an image;
by moving “non-edge” data we also simplify the data.
68
Edges è rate of change
Rate of change è differentiation
Differentiation è difference in digital domain
![Page 69: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/69.jpg)
Edges• Discontinuities in images are features that are often useful for
initializing an image analysis procedure.• Edges are important information for understanding an image;
by moving “non-edge” data we also simplify the data.
69
Edges è rate of change
Rate of change è differentiation
Differentiation è difference in digital domain
• Goal: Identify sudden changes (discontinuities) in an image– Most semantic and shape
information from the image can be encoded in the edges
– More compact than pixels– Marks the border of an object
![Page 70: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/70.jpg)
Characterizing Edges
70
• An edge is a place of rapid change in the image intensity function
70
imageintensity function
(along horizontal scanline) first derivative
edges correspond toextrema of derivative
![Page 71: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/71.jpg)
Derivative of Images
71
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
−−−
⇒101101101
31
xfDerivative masks
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
−−−⇒
111000111
31
yf
⎥⎥⎥⎥⎥⎥
⎦
⎤
⎢⎢⎢⎢⎢⎢
⎣
⎡
=
20202010102020201010202020101020202010102020201010
I
⎥⎥⎥⎥⎥⎥
⎦
⎤
⎢⎢⎢⎢⎢⎢
⎣
⎡
=
0000000101000010100001010000000
xI
![Page 72: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/72.jpg)
Laplacian: Difference of Gaussians
72
Gaussian Derivative of Gaussianin x direction
(gradient)
Derivative of Gaussianin y direction
(gradient)
Laplacian ofGaussian
![Page 73: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/73.jpg)
Difference of Gaussians ~ Laplacian
73
![Page 74: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/74.jpg)
How to measure for evaluating noise removal algorithms?
• Simultaneously suppressing noise and retaining high contrast is difficult … trade-off game. Filter Operating Characteristic (FOC) curve captures this trade-off.
Residual Standard deviation of intensity within pbject regionNoise RN:
Relative
Contrast RC:
• - object & background mean;
• - object & background std.
• FOC is a curve of 1-RC vs 1-RN.
74
![Page 75: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/75.jpg)
How to measure for evaluating noise removal algorithms?
• SNR (signal-to-noise ratio): basic measure of image quality
• SNR in an image is simply determined by averaging signal intensity within similar-sized regions of interest (ROIs) inside and outside the sample (background).
• CNR (contrast-to-noise ratio): (S1-S2)/N
• CNR in an image is determined by averaging signal intensity in similar-sized ROIs placed within two objects in the sample and another ROI outside the sample
75
![Page 76: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/76.jpg)
76
SNR (S/N) (of normal brain) and CNR (C/N) of multiple sclerosis plaques to normal brain on spin-density and T1 magnetic resonance images.
![Page 77: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/77.jpg)
77
![Page 78: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/78.jpg)
Summary• CAVA: computer aided visualization and analysis• CAD: computer aided diagnosis• Coordinate Systems• Pre-Processing Images
– Gaussian Smoothing, Median Filtering, Unsharp Masking– Edge Enhancement– Evaluation for image quality metric (contrast and noise)
78
![Page 79: Lec3: Pre-Processing Medical Images](https://reader031.fdocuments.in/reader031/viewer/2022020301/58ed21011a28abc95f8b45e1/html5/thumbnails/79.jpg)
References and Slide Credits• Jayaram K. Udupa, MIPG of University of Pennsylvania, PA.• P. Suetens, Fundamentals of Medical Imaging, Cambridge
Univ. Press.• N. Bryan, Intro. to the science of medical imaging, Cambridge
Univ. Press.• CAP 5415 Computer Vision (Fall 2016) Lecture Presentations
• Next Lecture (Preprocessing of Medical Images II)– Diffusion based Smoothing in Medical Scans– Intensity inhomogeneity Correction in MRI– Intensity Standardization in MRI– Noise Removal in PET/SPECT Images
79