Computer Assisted Surgeryand

Medical Image Analysis

Computer Vision GroupArtificial Intelligence Laboratory

Massachusetts Institute of TechnologySurgical Planning Lab

Brigham and Women’s HospitalHarvard Medical School

Computer assisted surgery

• Goal:– Use computer vision techniques to plan and guide

surgical interventions, by giving the surgeon the ability to sense critical information that is not normally visible to her

• How?– Capture models of patient anatomy and function– Use to guide surgeon’s actions

Conventional Surgery: See the surface

Provided by Nakajima, Atsumi et al.

Image Guided Surgery: See under the surface

Provided by Leventon et al.

Intelligently aiding the surgeon

• Convert medical images into models of patient’s:– Structural anatomy– Functional anatomy

aorta

brachio cephalic

trunc

subclavian artery

common carotidartery

brachio cephalic trunc

pulmonary trunkpulmonary

veins

Central Vessels

Courtesy of Lorigo

Cartilage Thickness Mapping

Courtesy Warfield, Winalski

Functional information

Visualizing the surgical site

• Augmented reality visualizations

• Surgical guidance

• Simulation of surgical navigation

Visualizing the surgical site

• Augmented reality visualizations

• Surgical guidance

• Simulation of surgical navigation

Surgical navigation

Visualizing the surgical site

• Augmented reality visualizations

• Surgical guidance

• Simulation of surgical navigation