Pattern Recognition in 3D Imaging
Transcript of Pattern Recognition in 3D Imaging
![Page 1: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/1.jpg)
Pattern Recognition in 3D Imaging
Bastian Bier, Thomas Köhler, Andreas Maier
Pattern Recognition Lab
Friedrich-Alexander-Universität Erlangen-Nürnberg
12. April 2017
![Page 2: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/2.jpg)
Introduction
![Page 3: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/3.jpg)
3
Pattern Recognition Lab
● Founded in 1975
● Located in the computer science department (school of engineering)
● Our team:
• 5 professors
• 2 lecturers
• 5 Post-docs
• 55 PhD students
• 4 admins
Bastian Bier, Thomas Köhler
![Page 4: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/4.jpg)
4
Pattern Recognition Lab
Bastian Bier, Thomas Köhler
18%
41%7%
7%
11%
9%
7% Registration
Reconstruction
Segmentation
Phase Contrast
Computer Vision
Speech
Picewise LinearMethods
Research groups at the lab:
![Page 5: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/5.jpg)
5
Medical Image Segmentation
•Vessel segmentation
•Computational fluid dynamics (CFD) simulation
•User-driven liver segmentation
•Cell detection and segmentation in microscopy
Bastian Bier, Thomas Köhler
![Page 6: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/6.jpg)
6
Medical Image Registration
•Methods:
• Rigid & non-rigid registration
• Interventional registration
• Surface registration
• Epipolar consistency
•Applications:
• Retinal imaging for ophthalmology
• Image-guided surgery
• Radiation therapy
• Radiology
Bastian Bier, Thomas Köhler
![Page 7: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/7.jpg)
7
Medical Image Reconstruction
•Methods:
• CT/MRI reconstruction
• Molecular/hybrid imaging
• Image quality improvement
• Deep learning
•Applications:
• Cardiac imaging with C-arm CT
• Perfusion imaging with C-arm CT
• Weight-bearing reconstruction
Bastian Bier, Thomas Köhler
![Page 8: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/8.jpg)
9
Computer Vision
•Writer identification in historical documents
•Hyperspectral imaging
•3-D range imaging (Time-of-Flight)
Bastian Bier, Thomas Köhler
![Page 9: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/9.jpg)
Knee Imaging and RSA
![Page 10: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/10.jpg)
11
Knee Imaging Under Weight-Bearing Conditions
● Aim: measure cartilage deformation over time
Bastian Bier, Thomas Köhler
![Page 11: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/11.jpg)
12
Basics: Cone-Beam CT Reconstruction
● Source and detector rotate around object and acquire multiple 2D
x-ray images
● Known projection matrices from calibration
Backprojection (and some filtering) of the 2D images
Bastian Bier, Thomas Köhler
![Page 12: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/12.jpg)
13
C-Arm Cone-Beam CT Reconstruction Problems
● Saturation
● Beam hardening
● Truncation
● Metal artifacts
● Scatter
● Patient Motion
Motion Artifacts
Bastian Bier, Thomas Köhler
![Page 13: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/13.jpg)
14
Motion Correction Using Markers
1. Attach metallic markers
2. Detect them in the 2D projection images
3. Compute their 3D reference position
4. Estimate 6D rigid motion
Bastian Bier, Thomas Köhler
![Page 14: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/14.jpg)
15
The Markers are Making Trouble
● Tedious to place
● Overlap
● Time consuming
● Metal artifacts
Bastian Bier, Thomas Köhler
![Page 15: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/15.jpg)
16
Current Research: Marker-Free Approaches
2D/3D bone registration
● use 3D segmented bones
● motion field for every bone
Epipolar consistency
Range imaging
Bastian Bier, Thomas Köhler
![Page 16: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/16.jpg)
17
Outlook: Ideas for RSA
Bastian Bier, Thomas Köhler
Direction of future research:
Reconstruction-based RSA
● Problem: Photon starvation
● Novel reconstruction
techniques to enable marker-
free RSA
● Mixed 1 Bit Compressed
Sensing
● Registration with CAD
reference models
● 2D/3D using X-ray images
● 3D/3D using reconstructions
![Page 17: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/17.jpg)
Thank you very much for your attention
Questions?
![Page 18: Pattern Recognition in 3D Imaging](https://reader034.fdocuments.in/reader034/viewer/2022051801/62816f188c70b40eaf40f664/html5/thumbnails/18.jpg)
19
Pattern Recognition Lab
Bastian Bier, Thomas Köhler
https://www5.cs.fau.de/