Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)
-
Upload
ulas-bagci -
Category
Science
-
view
8 -
download
0
Transcript of Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)
![Page 1: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/1.jpg)
MEDICAL IMAGE COMPUTING (CAP 5937)
LECTURE 5: Pre-Processing Medical Images (III)(MRI Intensity Standardization)
Dr. Ulas BagciHEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL [email protected] or [email protected]
1SPRING 2017
![Page 2: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/2.jpg)
Outline• MR Intensity standardization• General preprocessing framework for MR images• Effects of pre-processing on image analysis tasks
2
![Page 3: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/3.jpg)
MR Intensity Non-Standardness• Acquisition-to-acquisition signal intensity variations (non-
standardness) are inherent in MR images.
3
![Page 4: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/4.jpg)
MR Intensity Non-Standardness• Acquisition-to-acquisition signal intensity variations (non-
standardness) are inherent in MR images.
4
![Page 5: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/5.jpg)
MR Intensity Non-Standardness• Acquisition-to-acquisition signal intensity variations (non-
standardness) are inherent in MR images.
PD PD T2 T2
5
![Page 6: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/6.jpg)
MR Intensity Non-Standardness• What is changed?
PD PD T2 T2
6
![Page 7: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/7.jpg)
MR Intensity Non-Standardness• Intensity inhomogeneity is removed! (N3 or SBC can be
used).
PD PD T2 T2
7
![Page 8: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/8.jpg)
What is changed now? 8
![Page 9: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/9.jpg)
Intensities are standardized!
9
![Page 10: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/10.jpg)
Intensity Non-Standardness• MR image intensities do not possess a tissue-specific
numeric meaning even in images acquired for – the same subject, – on the same scanner, – for the same body region, by using the same pulse sequence
10
![Page 11: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/11.jpg)
Intensity Non-Standardness• MR image intensities do not possess a tissue-specific
numeric meaning even in images acquired for – the same subject, – on the same scanner, – for the same body region, by using the same pulse sequence
11
same brain slice,same person,same scanners,different imaging times,intensities are significantlydifferent for the sameTissue type!
![Page 12: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/12.jpg)
Summary of Problems• MRI intensities do not have a fixed meaning, even for the
same protocol, body region, patient, scanner.
12
![Page 13: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/13.jpg)
Summary of Problems• MRI intensities do not have a fixed meaning, even for the
same protocol, body region, patient, scanner.• Poses problems for image segmentation and analysis
13
![Page 14: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/14.jpg)
Summary of Problems• MRI intensities do not have a fixed meaning, even for the
same protocol, body region, patient, scanner.• Poses problems for image segmentation and analysis• Do you think linear scaling will help? (normalization)?
– Shifting intensity values linearly to other parts of the histogram?
14
![Page 15: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/15.jpg)
Summary of Problems• MRI intensities do not have a fixed meaning, even for the
same protocol, body region, patient, scanner.• Poses problems for image segmentation and analysis• Simple linear scaling does not help!
15
![Page 16: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/16.jpg)
16
10 DifferentPD studies
ORIGINAL HISTOGRAMS
Credit: L. Nyul
![Page 17: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/17.jpg)
17
10 DifferentPD studies
ORIGINAL HISTOGRAMS
BACKGROUND
FOREGROUND
Credit: L. Nyul
![Page 18: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/18.jpg)
18
10 DifferentPD studies
ORIGINAL HISTOGRAMS
BACKGROUNDFOREGROUND
AFTER STANDARDIZATION
Credit: L. Nyul
![Page 19: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/19.jpg)
19
OriginalGray Scale
After IntensityStandardization
Credit: L. Nyul
![Page 20: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/20.jpg)
How to Standardize MRI Intensities?
20
![Page 21: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/21.jpg)
How to Standardize MRI Intensities?• Histogram
21
![Page 22: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/22.jpg)
How to Standardize MRI Intensities?• Histogram
22
Mono-modalBi-modal
![Page 23: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/23.jpg)
How to Standardize MRI Intensities?• Histogram
23
Mono-modalBi-modal
Minimumintensity
Maximumintensity
Second modeOf the histogram
Shoulder of the Background hump
Minimum and maximum Percentile intensities
![Page 24: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/24.jpg)
How to Standardize MRI Intensities?• Histogram
24
Mono-modalBi-modal
Minimumintensity
Maximumintensity
Second modeOf the histogram
Shoulder of the Background hump
Minimum and maximum Percentile intensities
![Page 25: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/25.jpg)
How to Standardize MRI Intensities?• Histogram
25
Mono-modalBi-modal
Minimumintensity
Maximumintensity
Second modeOf the histogram
Shoulder of the Background hump
Minimum and maximum Percentile intensities
![Page 26: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/26.jpg)
How to Standardize MRI Intensities?• Histogram
26
Mono-modalBi-modal
Minimumintensity
Maximumintensity
Second modeOf the histogram
Shoulder of the Background hump
Minimum and maximum Percentile intensities
![Page 27: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/27.jpg)
How to Standardize MRI Intensities?• Histogram
27
Mono-modalBi-modal
Minimumintensity
Maximumintensity
Second modeOf the histogram
Shoulder of the Background hump
Minimum and maximum Percentile intensities
![Page 28: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/28.jpg)
Map background and foreground into the fixed intensity regions!
28
ßLocation of different modes
![Page 29: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/29.jpg)
Map background and foreground into the fixed intensity regions!
29
Fixed (standardized modes)
![Page 30: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/30.jpg)
30
IMAGE SCALE
STANDARD SCALE
m1i p1i µi p2i m2i
s’1i
s’2i
s1
s2
µs
![Page 31: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/31.jpg)
31
IMAGE SCALE
STANDARD SCALE
m1i p1i µi p2i m2i
s’1i
s’2i
s1
s2
µs
(known, fixed)
![Page 32: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/32.jpg)
32
IMAGE SCALE
STANDARD SCALE
m1i p1i µi p2i m2i
s’1i
s’2i
s1
s2
µs
(known, fixed)
for a given image i,we must calculatethese parameters fromhistogram and then transform them intothe standard scalevalues.
![Page 33: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/33.jpg)
33
IMAGE SCALE
STANDARD SCALE
m1i p1i µi p2i m2i
s’1i
s’2i
s1
s2
µs
(known, fixed)
s2 � µs
µs � s1
µi � p1i
p2i � µi
![Page 34: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/34.jpg)
34
IMAGE SCALE
STANDARD SCALE
m1i P1i x µi p2i m2i
s’1i
s’2i
s1
s2
µs
(known, fixed)
s2 � µs
µs � s1
µi � p1i
p2i � µi
![Page 35: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/35.jpg)
35
IMAGE SCALE
STANDARD SCALE
m1i P1i xµi p2i m2i
s’1i
s’2i
s1
s2
µs
(known, fixed)
s2 � µs
µs � s1
µi � p1i
p2i � µi
![Page 36: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/36.jpg)
Intensity Mapping Function
36
![Page 37: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/37.jpg)
Standardized Intensity Mapping T1-MRI
37
Original Scale
Standard Scale
![Page 38: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/38.jpg)
How to determine standardized parameters?
38
One way is to have some training images, and find average values (or median) for Histogram parameters
![Page 39: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/39.jpg)
Foot MRI Intensity Standardization
39
Original Scale
Standard Scale
![Page 40: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/40.jpg)
Different Body region, MR Modality, and Subjects for Training?
40
![Page 41: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/41.jpg)
Different Body region, MR Modality, and Subjects for Training? (mixed training)
41
![Page 42: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/42.jpg)
Quantitative Comparisons
42
Credit: L. Nyul
![Page 43: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/43.jpg)
Interplay between Denoising, Bias Correction, and Intensity Standardization ?
43
Denoising IntensityStandardization
Bias Correction
Intensity Standardization
Bias Correction Denoising
Bias Correction Denoising Intensity
Standardization
Bias Correction
Intensity Standardization Denoising
(A)
(B)
(C)
(D)
![Page 44: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/44.jpg)
Interplay between Denoising, Bias Correction, and Intensity Standardization ?
44
Denoising IntensityStandardization
Bias Correction
Intensity Standardization
Bias Correction Denoising
Bias Correction Denoising Intensity
Standardization
Bias Correction
Intensity Standardization Denoising
(A)
(B)
(C)
(D)
![Page 45: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/45.jpg)
Effects of Intensity Standardization on Image Registration
• The results from literature (Bagci PRL 2010) imply that the accuracy of image registration not only depends on spatial and geometric similarity but also on the similarity of the intensity values for the same tissues in different images
45
![Page 46: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/46.jpg)
Effects of Intensity Standardization on Image Registration
• The results from literature (Bagci PRL 2010) imply that the accuracy of image registration not only depends on spatial and geometric similarity but also on the similarity of the intensity values for the same tissues in different images
46
![Page 47: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/47.jpg)
Effects of Intensity Standardization on Image Segmentation
• Recap: Segmentation is to extract object information from image.
• For instance, extraction white matter tissue from MRI, identifying the boundaries of lung from CT, ….
47
![Page 48: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/48.jpg)
Effects of Intensity Standardization on Image Segmentation
• Y.Zhuge et al (CVIU 2009) showed that intensity standardization simplifies brain image segmentation
48
![Page 49: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/49.jpg)
Effects of Intensity Standardization on Image Segmentation
• Y.Zhuge et al (CVIU 2009) showed that intensity standardization simplifies brain image segmentation
The procedure for segmenting the brain tissues consists of the following steps.• (S1). Correcting for RF field inhomogeneity.• (S2). Standardizing MRI scene intensities.• (S3). Training to estimate parameters of the segmentation
method.• (S4). Creating brain intracranial mask.• (S5). Estimating tissue membership values.• (S6). Segmenting brain tissue regions.
49
![Page 50: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/50.jpg)
Effects of Intensity Standardization on Image Segmentation
• Y.Zhuge et al (CVIU 2009) showed that intensity standardization simplifies brain image segmentation
50
Before standardization After standardization
![Page 51: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/51.jpg)
Effects of Intensity Standardization on Anatomy Recognition (Localization/Initialization)
• Bagci et al TMI 2012 showed that object localization is affected from intensity non-standardness.
• MOE: mean orientation error• SD: standard deviation• MTE: mean translation error• 1…7, increasing order of standardness
51
![Page 52: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/52.jpg)
Summary• Intensity non-standardness is inherent in MRI
– Must standardize• Intensity standardization + inhomogeneity correction +
denoising need to be handled prior to image analysis• Intensity non-standardness affects
– Perception/qualitative analysis– Image analysis/quantification
• Segmentation• Registration• Recognition/localization
52
![Page 53: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/53.jpg)
Summary• Intensity non-standardness is inherent in MRI
– Must standardize• Intensity standardization + inhomogeneity correction +
denoising need to be handled prior to image analysis• Intensity non-standardness affects
– Perception/qualitative analysis– Image analysis/quantification
• Segmentation• Registration• Recognition/localization
PROGRAMMING ASSIGNMENT 1 IS AVAILABLE THIS WEEK !!!
53
![Page 54: Lec5: Pre-Processing Medical Images (III) (MRI Intensity Standardization)](https://reader030.fdocuments.in/reader030/viewer/2022021507/58ed20e51a28ab43498b4675/html5/thumbnails/54.jpg)
References and Slide Credits• Jayaram K. Udupa, MIPG of University of Pennsylvania, PA.• P. Suetens, Fundamentals of Medical Imaging, Cambridge Univ.
Press.• N. Bryan, Intro. to the science of medical imaging, Cambridge Univ.
Press.
• Madabhushi, et al. IEEE TMI 2005.• Madabhushi, et al., Medical Physics 2006.• Y. Ge et al, J. of MRI, 2000.• Bagci et al., PRL 2010.• Zhuge and Udupa, CVIU 2009.• Bagci, et al. IEEE TMI 2012.• Nyul and Udupa, Magnetic Resonance in Medicine, 1999.
54