The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1 .

58
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL http :// gamma.cs.unc.edu/DAB http://gamma.cs.unc.edu/IMPASTO http://gamma.cs.unc.edu/VISCOUS http://gamma.cs.unc.edu/BRUSH Virtual Painting

Transcript of The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1 .

Page 1: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

1

http://gamma.cs.unc.edu/DAB

http://gamma.cs.unc.edu/IMPASTO

http://gamma.cs.unc.edu/VISCOUS

http://gamma.cs.unc.edu/BRUSH

Virtual Painting

Page 2: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

2

Digital Painting

Alvy Ray Smith and Ed Ernshwillerworking on “Paint”, 1979

Many advantages• Undo mistakes• Perfect copies• Unlimited

reprints• No material cost• No drying• No fading or

decay• No physical limits

Page 3: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

3

Traditional Painting

“The dispatch with which a number of effects can be obtained by a direct, simple technique” – Mayer 1991, The Artist’s Handbook

Rich, dynamic behaviorDeformable brushesFluid paint

Intuitive control3D inputVisual and haptic feedback

The process

Page 4: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

4

GoalEnable realistic interactive painting on computer with thick medium using realistic 3D brushes

Page 5: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

5

Applications

Training

Education

Entertainment

Production

Page 6: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

6

Artist’s Quote

“My artist's toolbox has oils and acrylics—and a computer. But the computer’s not tactile, and I miss that. You can't push junk around.”

– Tia, Pixar Animation Studios

http://www.pixar.com/artistscorner/tia/interview.html

Page 7: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

7

Artist’s Quote

“I have used painter and psp [Paint Shop Pro] for a few yrs, and would welcome something better, would fight for, would almost die for a program like is described.”

--received by email 8/27/04

Page 8: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

8

Problem OverviewBrush

Complex geometryStiff dynamical system

PaintComplex surfaceComplex behaviorSubsurface scattering

HapticsNeeds stabilityNeeds kHz updates

InteractionCanvas Brush contactCanvas Brush transfers

IntegrationAll simulations must work interactively simultaneously

Page 9: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

9

Natural Media

Rudolf et al. 2003Rudolf et al. 2003

Curtis et al. 1997Curtis et al. 1997

Xu, et al. 2003Xu, et al. 2003Chu & Tai 2002Chu & Tai 2002

Corel Painter 8, 2003Corel Painter 8, 2003

Sousa, 1999Sousa, 1999

Page 10: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

10

Brush Simulation

Strassman, 1986Strassman, 1986

Wong & Ip, 2000Wong & Ip, 2000

Chu & Tai, 2003Chu & Tai, 2003

Xu et al., 2003,2004Xu et al., 2003,2004

Only for ink painting Specialized geometryLower stiffnessNo real bristlesNo paint pickupSome not interactive

Page 11: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

11

System Context

Page 12: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

12

Input

Page 13: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

13

Brush Simulation

Page 14: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

14

Paint Simulation

Page 15: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

15

Paint Rendering

Page 16: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

16

System Overview

Page 17: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

17

System Demonstration

http://www.youtube.com/watch?v=tZq-cpeZm8Q

Page 18: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

18

Brush ModelingGeometric modeling

Brush has 1,000’s of hairsEach interacts with paint & roughness/tooth of canvas

Dynamic simulationEach hair deformable and independentBristles have stiff dynamics

Page 19: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

19

Geometric Modeling

Exploit bristle coherenceDefine skeletal “spine” bristlesDeform surface or interpolate bristles

For smoother, neater marks For coarser, rougher marks

Page 20: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

20

Brush Spine Dynamics

Stiff dynamical systemForce large, mass smallNumerical integration requires small timestep

Page 21: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

21

Minimization Approach

Brush always at equilibrium so

A statics problemOr quasi-static since

Energy minUse standard, robust minimizer

E.g. Quasi-Newton SQP(Sequential Quadratic Programming)

Page 22: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

22

Brush Energy Minimization

Minimize

where

Subject to

Spring energy

Friction loss

Damping loss

Page 23: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

23

Brush Modeling Results

Page 24: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

24

System Demonstration

Video

Page 25: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

25

dAb Paint Simulation

Fast and simple2D paint behaviorModest system requirementsFirst bi-directional brush transferFirst complex loading

Page 26: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

26

Complex brush loading

Enabled by 3D brush model + bi-directional transferAn essential technique in traditional paintingDifficult previouslyUseful component of interface

Virtual Painting

Page 27: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

27

dAb Result Images

Page 28: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Frog

Rebecca Holmberg

Page 29: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Apple

Sarah Hoff

Page 30: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Meadow

Rebecca Holmberg

Page 31: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Man

Lauren Adams

Page 32: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Blossoms

Eriko Baxter

Page 33: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Road Bug

Rebecca Holmberg

Page 34: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

34

Fluid Motion

Steps:Determine velocity fieldAdvect material

Page 35: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

35

Simulating Paint - Velocity

Paint is a Viscous / Viscoplastic Fluid

Subject to boundary conditions

advection pressure viscosity elasticity

incompressibility

acceleration

Page 36: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

36

Material Advection

Given velocity field v, move material according to the advection equation:

Material = Pigment & fieldSemi-Lagrangian advection

Page 37: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

37

System Demonstration

Video

Page 38: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

38

Viscous Result Images

Page 39: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Woman in a Hat

Eriko Baxter

Page 40: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Field of Flowers

Eriko Baxter

Page 41: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The Beach

Andrea Mantler

Page 42: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Meadow

Haolong Ma

Page 43: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Abstract I

John Holloway

Page 44: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

44

IMPaSTo Paint Dynamics

Paint is very complex

IMPaSTo strategy:Model dominant terms

Page 45: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

45

2.5D Representation

Cross section of Monet’s Water Lillies

(Courtesy The Museum of Modern Art)

Page 46: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

46

Simulating Paint - Velocity

Paint is a Viscous / Viscoplastic Fluid

Subject to boundary conditions

advection pressure viscosity elasticity

incompressibility

acceleration

Page 47: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

47

Paint Color

Pigmented material Subsurface scattering

Mixes nonlinearly:Composites nonlinearly:

Kubelka-Munk model (1948,1954)

100% 0%+ = 50%

= + a (1-a)

Page 48: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

48

Measurement

Data collection setup

SpectraScan PR-715

5600K Illuminant

Page 49: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

49

Spectral Sampling

Use 8 wavelengthsSufficient (Duncan, 1949)Efficient on GPU

Gaussian quadratureChoose best 8 at runtime

CanvasReflectance Light Spectrum

Red

Green

Blue

R

G

B=

Page 50: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

50

Color Mixing Results

Page 51: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

51

System Demonstration

Video

Page 52: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL

52

IMPaSTo Result Images

Page 53: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Ajisai

Eriko Baxter

Page 54: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Woman

Andrea Mantler

Page 55: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Dame en Blau

Heather Wendt

Page 56: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Gogh Studios Room 1

William Baxter

Page 57: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Green

Eriko Baxter

Page 58: The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL 1    .

Abstract III

John Holloway