ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

37
ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez

Transcript of ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Page 1: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

ITKv4 – Spatial Objects

Arnaud Gelas – Luis Ibanez

Page 2: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Beyond the Image...

Page 3: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

So far...

FILTERInputImage

OutputImage

Page 4: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Only Recently...

FILTERInputMesh

OutputMesh

Page 5: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

The Future...

FILTER

InputImageMesh

TimeSequence...

Objects?

Page 6: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Spatial Objects itkArrowSpatialObject itkBlobSpatialObject itkBoxSpatialObject itkContourSpatialObject itkCylinderSpatialObject itkDTITubeSpatialObject itkEllipseSpatialObject itkGaussianSpatialObject itkGroupSpatialObject itkImageMaskSpatialObject itkImageSpatialObject itkLandmarkSpatialObject

itkLineSpatialObject itkMeshSpatialObject itkPlaneSpatialObject itkPointBasedSpatialObject itkPolygonGroupSpatialObje

ct itkPolygonSpatialObject itkSceneSpatialObject itkSpatialObject itkSurfaceSpatialObject itkTubeSpatialObject itkVesselTubeSpatialObject

Page 7: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Spatial Objects

itk::Image

itk::ImageSpatialObject

Page 8: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Spatial Objects

itk::Mesh

itk::MeshSpatialObject

Page 9: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

At the Beginning...

Region of Space

Is P Inside ?

P

SpatialObject

Page 10: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Spatial Objects

The Bounding

Box

Page 11: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Spatial Objects

The Bounding

BoxSpace

Time

Page 12: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Spatial Objects

T1Space

Time

T2

Page 13: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

The Bounding

Box

Spatial Objects

T1Space

Time

T2 ?

Page 14: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

We are all connected...

Human

Arm

Hand Forearm

Liver

Vasculature

Page 15: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Scene Graphs...

Surgery Table

CT Scan 1

MRI - A Mesh 1

Ultrasound

Contour

Transform Transform

TransformTransformTransform

Page 16: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Scene Graphs...

Surgery Table 3D

Ultrasound 2D

Transform

Page 17: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Scene Graphs...

Is it a TREE ?Is it a GRAPH ?

Page 18: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

We want Numbers !

FILTERSpatialObjects

Parameters(intensity,

Shape,Statistics,speed,...

Page 19: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

We want Numbers !

FILTERSpatialObjects

LabelMaps

FILTERLabelMaps

Parameters

Page 20: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Time is more than an Illusion...

SpatialObjects

SpatioTemporalObjects

Page 21: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Time is more than an Illusion...

(x, y, z, t )

Page 22: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Time is more than an Illusion...

itk::Point

At time T...

Page 23: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Time is more than an Illusion...

itk::SpatialObject

At time T...

Page 24: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Time is more than an Illusion...

itk::SpatialObject

Or Across Time...

Page 25: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Mikowsky Diagrams...

Space

Time

(x,y,z,t)

Page 26: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Mikowsky Diagrams...

Space

Time

(x,y,z,t)

History of a 3D object

Page 27: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Mikowsky Diagrams...

Space

Time

(x,y,z,t)

Interpolate inSpace and Time

Page 28: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Mikowsky Diagrams...

Space

Time

(x,y,z,t)

or...Is this aSingle 3D+t object ?

Page 29: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

The Time Continuum...

Spatial ObjectTime 1

Spatial ObjectTime 2

Spatial Object

Time 1.5

Time Interpolation ?

Page 30: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Topological Changes

Space

Time

(x,y,z,t)

Cellular Mitosis

Page 31: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Topological Changes

Space

Time

(x,y,z,t)

How to Interpolate ?

Page 32: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Topological Changes

Space

Time

(x,y,z,t)

Cellular Fusion

Page 33: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Topological Changes

Space

Time

(x,y,z,t)

How toInterpolate ?

Page 34: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

End

Page 35: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Discussion

Model to image registration Optimize over SO, shape parametes

Moving from App level representation towards the lower level in ITK (e.g. to share among apps such as V3D, GoFigure,...)

Create a itk::GraphObject ? Use Boost graph library ? (as a module) Nick wrote one...(at the time we didn't want Boost..) Data in nodes & data in edges (e.g. transforms)..

Page 36: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Discussion

What information to put in Nodes ? What to put in Edges ?

How to manage IO ? get it from boost ? Use graphviz ?

ItkGraphObject Nodes → Template argument Edge →

Page 37: ITKv4 – Spatial Objects Arnaud Gelas – Luis Ibanez.

Discussion

What information to put in Nodes ? What to put in Edges ?

How to manage IO ? get it from boost ? Use graphviz ?

ItkGraphObject Nodes → Template argument Edge →