Relief: A Modeling by Drawing Tool
description
Transcript of Relief: A Modeling by Drawing Tool
![Page 1: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/1.jpg)
Relief: A Modeling by Drawing Tool
David Bourguignon1 Raphaëlle Chaine2
Marie-Paule Cani3 George Drettakis4
1Princeton University / INRIA Rocquencourt 2LIRIS / CNRS / UCBL3GRAVIR / INP Grenoble 4REVES / INRIA Sophia-Antipolis
![Page 2: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/2.jpg)
Outline
• Motivation• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 3: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/3.jpg)
On Users
• Most people draw– Writing alternative
• Few people sculpt– Play-Doh days long gone– Materials difficult to handle
![Page 4: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/4.jpg)
Goals
• Use 2D tools to perform 3D operations
![Page 5: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/5.jpg)
Goals
• Use 2D tools to perform 3D operations• Model global and local surface
![Page 6: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/6.jpg)
Goals
• Use 2D tools to perform 3D operations• Model global and local surface• Input: just plain strokes
![Page 7: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/7.jpg)
Goals
• Use 2D tools to perform 3D operations• Model global and local surface• Input: just plain strokes• Output: triangle mesh
![Page 8: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/8.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 9: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/9.jpg)
Previous Work
• Depth painting [Williams, 1990]
+
![Page 10: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/10.jpg)
Previous Work
• Gradient editing [van Overveld, 1996]
![Page 11: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/11.jpg)
Previous Work
• Maya 6.0 Artisan [Alias, 2004]
![Page 12: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/12.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 13: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/13.jpg)
Tool Workflow
• First step: drawing input– Displacement map
• mid-grey = 0• white > 0• black < 0
Model of 3D sphere
Pencil
Brush
![Page 14: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/14.jpg)
Tool Workflow
• First step: drawing– Displacement map– 2D shape boundary
(in green)• defines drawing mask
![Page 15: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/15.jpg)
Tool Workflow
• First step: drawing– Displacement map– 2D shape boundary– Displacement regions (from 2 maps)
![Page 16: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/16.jpg)
Tool Workflow
• Second step: modeling– Displace existing vertices
![Page 17: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/17.jpg)
Tool Workflow
• Second step: modeling– Displace existing vertices– Create new surface patch
![Page 18: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/18.jpg)
Tool Workflow
• Changing viewpoint
Modeling by drawing
Changing viewpoint
![Page 19: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/19.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
![Page 20: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/20.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
• Satisfy our requirements– Arbitrary number of connected components
![Page 21: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/21.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
• Satisfy our requirements– Arbitrary number of connected components– Handle points off shape boundary
![Page 22: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/22.jpg)
Reconstruction
• Based on evolving pseudo-manifold [Chaine, 2003]
• Satisfy our requirements– Arbitrary number of connected components– Handle points off shape boundary– Interactive (5k points per second)
![Page 23: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/23.jpg)
2D reconstruction
• Start: pseudo-curve lies on oriented edges of Delaunay triangulation
![Page 24: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/24.jpg)
2D reconstruction
• During: pseudo-curve evolves as long as oriented Gabriel criterion is not met
![Page 25: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/25.jpg)
2D reconstruction
• Stop: topologically consistent set of oriented edges
![Page 26: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/26.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map
• Pencil and brush datain color buffer
Color buffer
![Page 27: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/27.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map– Approximate disp. map
sampled at existing vertices
![Page 28: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/28.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map (D)– Vertex-Sampled disp.
map (V)– Error map
E = 1 – ABS(D – V)– Arbitrary error value
![Page 29: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/29.jpg)
Sampling and Depth
• Adaptive sampling– Displacement map– Approximate disp. map– Error map– Sampling [Alliez, 2002]
![Page 30: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/30.jpg)
Sampling and Depth
• Adaptive sampling• Depth inference
– Identify surface vertices
Vertices ID buffer
![Page 31: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/31.jpg)
Sampling and Depth
• Adaptive sampling• Depth inference
– Identify surface vertices– Assign depth values
Depth buffer
![Page 32: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/32.jpg)
Sampling and Depth
• Adaptive sampling• Depth inference
– Identify surface vertices– Assign depth values– Infer depth values
• from existing surface• by depth propagation
![Page 33: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/33.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 34: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/34.jpg)
Tool Interface
• Hole marks– Comic books production
Hole marks
Stone #3 (Avalon Studios)
![Page 35: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/35.jpg)
Tool Interface
• Hole marks– Comic books production– Our system
Hole mark
![Page 36: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/36.jpg)
Tool Interface
• Video: Basic interface
![Page 37: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/37.jpg)
Tool Interface
• Blobbing
Drawing White shadingDistance field Height field Surface
![Page 38: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/38.jpg)
Tool Interface
• Depth modes (chosen by menu)
Modeling “at depth”Depth inference Frisket mode
![Page 39: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/39.jpg)
Video
• Modeling a tree
Paper sketch 3D model obtained with Relief
![Page 40: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/40.jpg)
Outline
• Motivations• Previous Work• Tool Workflow• Reconstruction• Adaptive Sampling & Depth Inference• Tool Interface• Results
![Page 41: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/41.jpg)
Results
• Models (1k to 4k points)
![Page 42: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/42.jpg)
Discussion
• Intuitive shading convention
![Page 43: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/43.jpg)
Discussion
• Intuitive shading convention• Problems with drawing metaphor
– No continuous visual feedback• Provide two modes
![Page 44: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/44.jpg)
Discussion
• Intuitive shading convention• Problems with drawing metaphor
– No continuous visual feedback– Difficult to obtain continuous shading
• Provide higher-level drawing tools
![Page 45: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/45.jpg)
Conclusion
• Modeling by drawing, but imprecise
![Page 46: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/46.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction
![Page 47: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/47.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction– Improve depth inference
![Page 48: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/48.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction– Improve depth inference– Image-space and object-space sampling
![Page 49: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/49.jpg)
AcknowledgementsThis work has been performed while the first author was a visiting research fellow at Princeton University, supported by an INRIA post-doctoral fellowship.
Many people have indirectly contributed to it. We would like to thank: Adam Finkelstein, Szymon Rusinkiewicz, Jason Lawrence, Pierre Alliez, Mariette Yvinec, Laurence Boissieux, Laure Heïgéas, Laks Raghupathi, Olivier Cuisenaire, Bingfeng Zhou.
![Page 50: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/50.jpg)
![Page 51: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/51.jpg)
![Page 52: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/52.jpg)
Reconstruction
• Input: shape from strokes– 2D reconstruction– 3D reconstruction
![Page 53: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/53.jpg)
Problems to be solved
• Provide appropriate drawing rep.– Shape from strokes
![Page 54: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/54.jpg)
Tool Workflow
• Second step: modeling– Adaptive sampling
![Page 55: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/55.jpg)
Tool Workflow
• Second step: modeling– Adaptive sampling– Depth inference
![Page 56: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/56.jpg)
Our Approach
• Provide appropriate drawing rep.– Shape from strokes– Displacement from shading
• White/black metaphor for displacement
Rafaello Sanzio
![Page 57: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/57.jpg)
Our Approach
• Provide appropriate drawing rep.• Provide appropriate surface rep.
– Free-form appearance
![Page 58: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/58.jpg)
Our Approach
• Provide appropriate drawing rep.– 2D Shape from strokes
![Page 59: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/59.jpg)
Our Approach
• Provide appropriate drawing rep.• Provide appropriate surface rep.
– Free-form appearance– Arbitrary topology changes
![Page 60: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/60.jpg)
Outline
• Motivations• Previous Work• Contributions• Results
![Page 61: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/61.jpg)
Contributions Overview
• Curve and surface reconstruction
![Page 62: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/62.jpg)
Contributions Overview
• Curve and surface reconstruction• Adaptive sampling and depth inference
![Page 63: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/63.jpg)
Contributions Overview
• Curve and surface reconstruction• Adaptive sampling and depth inference• Modeling by drawing interface
![Page 64: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/64.jpg)
On Users
• Most people draw– Writing alternative
![Page 65: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/65.jpg)
On Users
• Most people draw– Writing alternative– Minimal tool set
![Page 66: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/66.jpg)
On Users
• Most people draw– Writing alternative– Minimal tool set– Since kindergarten
![Page 67: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/67.jpg)
On Users
• Most people draw• Few people sculpt
– Play-Doh days long gone
![Page 68: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/68.jpg)
Previous Work
• Wireframe reconstruction [Lipson, 1996]
![Page 69: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/69.jpg)
Previous Work
• Gesture-based interfaces
[Zeleznik, 1996] [Igarashi, 1999]
![Page 70: Relief: A Modeling by Drawing Tool](https://reader035.fdocuments.in/reader035/viewer/2022062521/56814bee550346895db8d2d6/html5/thumbnails/70.jpg)
Conclusion
• Modeling by drawing, but imprecise• Future work
– Speedup with local 3D reconstruction– Modeling alternative for “thin parts”
Current Alternative“Thin parts”