Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia...

18
Piattaforma Avanzata per la Pianificazione Pre-Operatoria nella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy Lucio Tommaso De Paolis , Giovanni Aloisio Augmented and Virtual Reality Laboratory (AVR Lab)

Transcript of Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia...

Page 1: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

Piattaforma Avanzata per la Pianificazione Pre-Operatoria nella Chirurgia Laparoscopica Pediatrica

Department of Innovation Engineering Salento University

Lecce, Italy

Lucio Tommaso De Paolis, Giovanni Aloisio

Augmented and Virtual Reality Laboratory (AVR Lab)

Page 2: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20102

One trend in surgery is the transition from open procedures to minimally invasive laparoscopic interventions where visual feedback to the surgeon is only available through the laparoscope camera and direct palpation of organs is not possible

As a promising technique, the practice of MIS is becoming more and more widespread and is being adopted as an alternative to the classical procedure

The availability of a system for the pre-operative planning can be of great help to the surgeon

MinimallyMinimally Invasive Invasive SurgerySurgery

Page 3: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20103

MinimallyMinimally Invasive Invasive SurgerySurgery

Page 4: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20104

ARPED Project(Augmented Reality Application in Pediatric Minimally Invasive Surgery)

AVR Lab – Dept. of Innovation Engineering - Salento University

ASL Lecce – Casarano Hospital – Pediatric Surgery Division

The application can be used for the pre-operative surgical planning and for

the overlapping on the real patient using the Augmented Reality technology

the trocar insertion points chosen on the virtual model

ARPED ProjectARPED Project

Page 5: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20105

The developed application allows surgeon:

gathering the information about the patient and his pathology

obtaining an informed consent using a multimedia-based information program

visualizing and interacting with the 3D models of the organs built from the patient’s medical images

measuring the dimensions of the organs

deciding the best position of the trocars insertion taking into account the visualized internal anatomy

overlapping these chosen points on the real patient using the Augmented Reality technology

ARPED ProjectARPED Project

Page 6: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20106

In the current climate of increasing awareness, patients are demanding more knowledge of the operative process

The term "informed consent" explains the process by which, before treatment, comprehensive and impartial information regarding a planned operative procedure is provided to a patient so that he can understand the implications of the procedure before consenting

Informed consent is a process of communication between patient and physician that results in the patient's authorization or agreement to undergo a specific medical intervention

The idea is to investigate if the standard methods of consenting can be improved using a multimedia-based information program

InformedInformed ConsentConsent

Page 7: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20107

ARPED ProjectARPED Project

3D Slicer and ITK-SNAP

VTK - Visualization Toolkit

PQP - Proximity Query Package

QT

Polaris Vicra of NDI

Page 8: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20108

All the patient’s information (personal details, diseases, specific pathologies,diagnosis, medical images, 3D models of the organs, notes of the surgeon, etc.) are structured in a XML file associated to each patient

ARPED ProjectARPED Project

Page 9: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 20109

The 3D models of the abdominal area has been reconstructed from CT images using some segmentation and classification algorithms

The Fast Marching algorithm has been used for the image segmentation

After a first semi-automatic segmentation, a manual segmentation has been carried out

Virtual Environment

Page 10: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 201010

Virtual Environment

Page 11: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 2010

1° case: child with a tumor at the kidney

11

ARPED ProjectARPED Project

Page 12: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 2010

2° case: child with a tumor of the peripheral nervous system (ganglioneuroma)

12

ARPED ProjectARPED Project

Page 13: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 2010

ApplicationApplication sectionssections

13

Page 14: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 2010

ApplicationApplication sectionssections

14

Page 15: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 2010

15

ARPED ProjectARPED Project

Page 16: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 2010

16

ARPED ProjectARPED Project

Page 17: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

La Medicina Incontra la Realtà VirtualePisa

14 Dicembre 201017

The developed application allows surgeon gathering information about the patient, interacting with the 3D models of the organs, measuring specific dimensions, choose the best position of the trocars insertion and overlapping the chosen points on the real patient using the AR technology

The application can be used for the pre-operative surgical planning and for informed consent

It has been tested on study cases already operated from the surgeon

The future work is the validation of the application on a new study case and to follow all the steps from the diagnosis to the surgical procedure

Conclusions and Future WorkConclusions and Future Work

Page 18: Piattaforma Avanzata per la Pianificazione Pre-Operatoria ... Paolis.pdfnella Chirurgia Laparoscopica Pediatrica Department of Innovation Engineering Salento University Lecce, Italy

Department of Innovation Engineering Salento University

Lecce, Italy

Prof. Giovanni Aloisio ([email protected])Eng. Lucio Tommaso De Paolis ([email protected])

www.avr.unisalento.it