A Web Interface for 3D Visualization and Interactive...
Transcript of A Web Interface for 3D Visualization and Interactive...
![Page 1: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/1.jpg)
21/08/12 1
A Web Interface for 3D Visualization and Interactive Segmentation of Medical
Images
H. Jacinto1,3, R. Kéchichian1, M. Desvignes2, R. Prost1, S. Valette1
1 : CREATIS2 : GIPSA-Lab3 : OneFit Medical SAS
![Page 2: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/2.jpg)
21/08/12 2
Some of our previous works
1998 : 3D progressive transmission
- html- Netscape plugin (c++)- Cosmo Player
![Page 3: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/3.jpg)
21/08/12 3
WebGL
2011 : Google BodyZygote Body
utf8 mesh encoder
→ Pure js is OK
65K limit
![Page 4: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/4.jpg)
21/08/12 4
Context
Female Virtual HumanCT scan512*512*1734 = 455 MB
Output :RenderingProcessing (segmentation, detection, ...)
Input :Imaging data : MRI, CT ScannersLarge Volumetric Data
![Page 5: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/5.jpg)
21/08/12 5
Medical visualization
MPRWhat physicians want
3D MeshesMedium Bandwidth
Remote Volume Renderinge.g. : ParaviewWebHigh bandwidthHigh server load
Volume RenderingHigh bandwidthHigh client load
MPR
Meshes
Volume Rendering
![Page 6: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/6.jpg)
21/08/12 6
MPR
Server-side : Precompute 2D slices
● In-core● about 1:1 RAM → DISK trade● slicing delay (fixable)
Client-side : WebGL (three.js)● <img> → texture● shaders provide:
• Contrast/brightness• HDR• Lookup Tables
![Page 7: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/7.jpg)
21/08/12 7
Under the hood
Server-side processing :
● Generic RPC framework● Bare filesystem as storage● RPC Caching
![Page 8: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/8.jpg)
21/08/12 8
Data Formats
Voxel Data: DICOM → RAW/ZRAW →Slices
Surfaces : .vtk, .ply, .stl → OpenCTM (just workstm)
utf8, x3d are a possibility,But no web format is the end-goal
![Page 9: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/9.jpg)
21/08/12 9
Interactive Segmentation
![Page 10: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/10.jpg)
21/08/12 10
Graph cuts
[Boykov & Jolly 2001]
![Page 11: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/11.jpg)
21/08/12 11
Graph cuts
Segmentation :Minimal cut
Multiple labels :α-expansion
![Page 12: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/12.jpg)
21/08/12 12
Dealing with complexity
[Kéchichian et al. 2011]
Pixels → Clusters → Segmentation
![Page 13: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/13.jpg)
21/08/12 13
Voronoi/Delaunay/Lloyd
Initial 2 iterations 50 iterations
E=∑i=1
N
∫V i
ρ(x ).d ( x , pi)2dx
![Page 14: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/14.jpg)
21/08/12 14
Anatomical priors
Fat
PatelaCartilage
F
CartilageT
Tibia
Femur
Misc.Outside
Fibula
![Page 15: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/15.jpg)
21/08/12 15
Results
![Page 16: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/16.jpg)
21/08/12 16
Meshing
Marching Cubes :Too many triangles
![Page 17: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/17.jpg)
21/08/12 17
Meshing
Approximated CentroidalVoronoi Diagrams[Valette & Chasserry 04]
![Page 18: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/18.jpg)
21/08/12 18
Experiments on tritons/newts
MRI
Segmentation/meshing
- 20 individuals- 2 postures 'I' and 'S'
Collaboration with T. Wardziak (U. Lyon)
![Page 19: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/19.jpg)
21/08/12 19
Arthroplasty
Orthopedics :The good angles
![Page 20: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/20.jpg)
21/08/12 20
One Fit adapters
![Page 21: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/21.jpg)
21/08/12 21
Some results
Reference Ours
![Page 22: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/22.jpg)
21/08/12 22
Source code
ClientJs (8 kLOC) + qooxdoo + three.js
Server.php (1 kLOC) OR .js (1 kloc) + node.js
RPC (c++)- slicing/meshing :
github.com/valette/ACVDVTKOpenCTMGDCM
- segmentation : proprietary license
![Page 23: A Web Interface for 3D Visualization and Interactive ...web3d2012.web3d.org/presentations/session2/web3D_final_lowres.pdf · 21/08/12 1 A Web Interface for 3D Visualization and Interactive](https://reader033.fdocuments.in/reader033/viewer/2022041506/5e25690556e75154d92070a5/html5/thumbnails/23.jpg)
21/08/12 23
Thank you