Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory
description
Transcript of Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory
![Page 1: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/1.jpg)
1
Dongqing Chen, Ph.D.
Computer Vision & Image Processing (CVIP) LaboratoryDepartment of Electrical & Computer Engineering
University of LouisvilleLouisville, KY, 20292
April 8, 2010
Shape Modeling of the Corpus Callosum for Shape Modeling of the Corpus Callosum for Neuroimaging Studies of the BrainNeuroimaging Studies of the Brain
(Part I)(Part I)
CVIP LabThe University of Louisville
![Page 2: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/2.jpg)
Anatomy of Brain
What is Autism?
Medical Imaging (NeuroImaging Using MRI) for Autism
Some Basic Concepts for Medical Imaging
General Framework of Shape Modeling by CVIP Lab
New Brain MRI Datasets (15 Autism & 30 Normal)
Dataset Processing (Conversion, Segmentation and Registration)
Some Results and Demo
OutlinesOutlinesOutlinesOutlines
![Page 3: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/3.jpg)
Brain Structure Brain Structure Brain Structure Brain Structure
[http://serendip.brynmawr.edu/bb/kinser/Structure1.html]
Frontal Lobe: reasoning, planning, parts of speech, movement, emotions, and problem solving Parietal Lobe: movement, orientation, recognition, perception of stimuli Occipital Lobe: visual processing Temporal Lobe: perception and recognition of auditory stimuli, memory, and speech
![Page 4: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/4.jpg)
Brain StructureBrain StructureBrain StructureBrain Structure
The corpus callosum:a structure connecting the left and right cerebral hemisphereswide, flat bundle of axons beneath the cortexfacilitating communication between the two hemispheresthe largest white matter structure in the brain (most computer algorithms designed for segmentation (WM, GM, & CSF) fail to segment the corpus callosum only)consisting of 200-250 million contralateral axonal projections
[http://en.wikipedia.org/wiki/Corpus_callosum]
![Page 5: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/5.jpg)
Introduction to AutismIntroduction to AutismIntroduction to AutismIntroduction to Autism
Dustin Hoffman
[http://en.wikipedia.org/wiki/Dustin_Hoffman]
Tom Cruise
[http://en.wikipedia.org/wiki/Tom_Cruise]
[http://www.imdb.com/title/tt0095953/]
![Page 6: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/6.jpg)
Neuro-developmental disorder
Impairments in social interaction, communication
Unusual behaviors and interests
According to Centers for Disease Control and Prevention (CDC), 1/150 American kids are autistic (4:1 ratio of boys
to girls)
Introduction to AutismIntroduction to AutismIntroduction to AutismIntroduction to Autism
![Page 7: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/7.jpg)
No definitive medical test for diagnosis
No reliable cause is identified
No cure. BUT: Therapies for specific symptoms
Challenges to AutismChallenges to AutismChallenges to AutismChallenges to Autism
Autism Movie
http://www.youtube.com/watch?v=nQxDG4LD1Eo&feature=related
![Page 8: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/8.jpg)
Introduction to AutismIntroduction to AutismIntroduction to AutismIntroduction to Autism
Brain Size
Enlarged Brain weight & Head CircumferenceNormal brain size at birth and rapid expansion by age 2By age 4 autistic children have brain the size of a typical 13-yrs old
Corpus Callosum
Deficits in the size of the Corpus Callosum (CC) and its sub-regions in patients with autism. Our work revealing distinctions in deformations of the CC regions
Corpus CallosumCorpus Callosum
![Page 9: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/9.jpg)
NeuroImaging: an important diagnosis tool
studying the brain’s structure with MRI or CT: reveal tumors, evidence of small or large strokes, damage from severe head trauma or a buildup of fluid.
NeuroImaging: functional and structural MRI
A primary medical imaging technique Based on the principle of nuclear magnetic resonance (NMR) Visualizing the structure and function of the body
NeuroImagingNeuroImagingNeuroImagingNeuroImaging
![Page 10: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/10.jpg)
DICOM Image Format:
Digital Imaging and Communications in Medicine (DICOM)
Standard for handling, storing, printing, and transmitting information in medical imaging (CT, MRI, PET, SPECT, etc).
Two Parts: DICOM Header and DICOM dataset
12 or 16 bits, higher than 8 bits in BMP, JPEG, TIFF, PGM
Matlab and VTK 5.0 + can read, display, convert and save
Introduction to Medical ImagingIntroduction to Medical ImagingIntroduction to Medical ImagingIntroduction to Medical Imaging
[http://en.wikipedia.org/wiki/Digital_Imaging_and_Communications_in_Medicine]
![Page 11: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/11.jpg)
Supine and Prone ScanningSupine and Prone ScanningSupine and Prone ScanningSupine and Prone Scanning
Supine position: lying down with the face up
Prone position: the body lying face down
MRI Scan of a Patient on Supine Position
![Page 12: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/12.jpg)
Sagittal, Coronal and Transverse Sagittal, Coronal and Transverse PlanePlane
Sagittal, Coronal and Transverse Sagittal, Coronal and Transverse PlanePlane
Sagittal plane: dividing the body into left and right parts.
Coronal plane: dividing the body into anterior and posterior parts.
Transverse plane: dividing the body into superior and inferior parts.
[http://en.wikipedia.org/wiki/Coronal_plane]
![Page 13: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/13.jpg)
ExamplesExamplesExamplesExamples
Coronal view Sagittal view Transverse view
Brain Transverse Movie Demo
![Page 14: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/14.jpg)
System ChartSystem ChartSystem ChartSystem Chart
![Page 15: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/15.jpg)
MRI Brain DatasetsMRI Brain DatasetsMRI Brain DatasetsMRI Brain Datasets
Autism Normal
Dataset Number 15 30
Received from Dr. Casanova at the Department of Psychiatry
GE 1.5T Signa HDxt MRI Scanner
124 Axial (Transverse), Coronal or Sagittal slices
Spatial resolution: 1.5 mm in the axial or 2.0 mm in the coronal or Sagittal
The spatial resolution for a pixel: 0.9375 × 0.9375 mm2.
![Page 16: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/16.jpg)
Dataset Extraction or Conversion Dataset Extraction or Conversion Dataset Extraction or Conversion Dataset Extraction or Conversion
%Create Coronal serial slices and savefor i=1:slice_num i tf = maketform_slicer(i-1, 'axi'); img_tmp = mri_slice(x.data, x.ijk2ras, tf); figure; imagesc(img_tmp); colormap(gray); title(num2str(i)); truesize; axis off; pause(0.01); close all; %save to pgm file img_name = sprintf('%s%s.%03d.pgm',path,output_name,i); savePGM(img_name,img_tmp);end
%This small program is coded to convert the Autistic MRI images to % the regular image format%based on the matlab codes given by Andrew%modified by Dongqing Chen, Ph.D. %This is the main file, which you just need to open each timeclose all;clc;clear all; %Autistic Brain MRI image folderpath='D:\Backup\New Autistic MRI data\Autism Data\4.aut.cor\4\';output_name='4_axi'; %Check either mri_read_signa or mri_read_genesis worksx=mri_read_signa(path);%x=mri_read_genesis(path); %Create Mid-saggital slicex=x{1};tf = maketform_slicer(0, 'axi');img = mri_slice(x.data, x.ijk2ras, tf);savePGM([path 'mid_sag.pgm'],img); figure;imagesc(img);colormap(gray);title('middle saggital view'); %Check the MRI data in x.data[row clm slice_num]=size(x.data);
Show Code Demo
![Page 17: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/17.jpg)
Dataset Extraction or Conversion Dataset Extraction or Conversion Dataset Extraction or Conversion Dataset Extraction or Conversion
%Create Coronal serial slices and savefor i=1:slice_num i tf = maketform_slicer(i-1, 'axi'); img_tmp = mri_slice(x.data, x.ijk2ras, tf); figure; imagesc(img_tmp); colormap(gray); title(num2str(i)); truesize; axis off; pause(0.01); close all; %save to pgm file img_name = sprintf('%s%s.%03d.pgm',path,output_name,i); savePGM(img_name,img_tmp);end
%This small program is coded to convert the Autistic MRI images to % the regular image format%based on the matlab codes given by Andrew%modified by Dongqing Chen, Ph.D. %This is the main file, which you just need to open each timeclose all;clc;clear all; %Autistic Brain MRI image folderpath='D:\Backup\New Autistic MRI data\Autism Data\4.aut.cor\4\';output_name='4_axi'; %Check either mri_read_signa or mri_read_genesis worksx=mri_read_signa(path);%x=mri_read_genesis(path); %Create Mid-saggital slicex=x{1};tf = maketform_slicer(0, 'axi');img = mri_slice(x.data, x.ijk2ras, tf);savePGM([path 'mid_sag.pgm'],img); figure;imagesc(img);colormap(gray);title('middle saggital view'); %Check the MRI data in x.data[row clm slice_num]=size(x.data);
![Page 18: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/18.jpg)
Examples of Saggital ViewExamples of Saggital ViewExamples of Saggital ViewExamples of Saggital View
![Page 19: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/19.jpg)
Segmentation of Corpus CallosumSegmentation of Corpus CallosumSegmentation of Corpus CallosumSegmentation of Corpus Callosum
![Page 20: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/20.jpg)
Segmentation of Corpus CallosumSegmentation of Corpus CallosumSegmentation of Corpus CallosumSegmentation of Corpus Callosum
Currently why Manual Segmentation?
1.Accurate2.Small Datasets3.Since corpus callosum is the largest white matter, most of the existing algorithm are designed to segment the whole white matter, and messed up the corpus collosum with other parts. (we tried level sets, statistical model (graph-cut), etc.)
4.Designing a 3D shape prior based segmentation
Currently why sagittal view?
1.Clear corpus callosum region with closed boundary2.Less slices numbers (9~12 compared with 50~70 slices along coronal view)
![Page 21: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/21.jpg)
Contour Extraction & SamplingContour Extraction & SamplingContour Extraction & SamplingContour Extraction & Sampling
75 sampling points
![Page 22: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/22.jpg)
Contour Extraction & SamplingContour Extraction & SamplingContour Extraction & SamplingContour Extraction & Sampling
75 sampling points
![Page 23: Dongqing Chen, Ph.D. Computer Vision & Image Processing (CVIP) Laboratory](https://reader034.fdocuments.in/reader034/viewer/2022051622/5681556b550346895dc33832/html5/thumbnails/23.jpg)
Topics for next talk and future Topics for next talk and future workwork
Topics for next talk and future Topics for next talk and future workwork
For next talk:
Bezier curve fitting and reconstruction
PCA based classification
Classification results on 15 autism and 20 normal datasets
For Future work:
Idea on prior shape based 3D segmentation & Registration