1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai...

40
1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

Transcript of 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai...

Page 1: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

1

SD Models:Super-Deformed Character ModelsSheng-Jie LuoLiang-Tsen Shen Bing-Yu ChenChiun-Kai

HuangNational Taiwan University

Page 2: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

2

SD

1

7

1

2.5

© Crypton Future Media, INC.

Page 3: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

3

Applications

Ahmed lumei

© Rilakkuma

Page 4: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

4

Challenges

Page 5: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

5

Goal

Input model

Output model

- +Head Proportion

- +Body-to-feet Proportion

- +Body-to-head Width Proportion

Body Proportions

- +Enlarge Scale

- +Stretch Scale

Signature Characteristics

optimization

Page 6: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

6

Related Work

Page 7: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

7

Mesh Deformation

Surface-based deformation techniques Alexa et al. 2003 Lipman et al. 2004 Sorkine et al. 2004 Zhou et al. 2005 Huang et al. 2006

Page 8: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

8

Mesh Deformation

Skeleton-based deformation techniques Linear-Blend Skinning (LBS)

Magenat-Thalmann et al. 1988 Lewis et al. 2000

Page 9: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

9

Geometry Processing

Mesh simplification Cigmoni et al. 1997 Garland et al. 1997 Lindstrom et al. 2000 Luebke et al. 2002

Page 10: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

10

Geometry Processing

Mesh smoothing Field et al. 1988 Shontz et al. 2003 Baker et al. 2004 Eigensatz et al. 2008

Page 11: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

11

Artistic Stylization

Deussen et al. 2000 Qu et al.

2008

Gal et al. 2007Rivers et al.

2010

Page 12: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

12

Our Method

Page 13: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

13

User Input: Body Proportion

Head proportion Body-to-feet proportion Body-to-head width proportion

- +- +- +

- +- +- +

- +- +- +

- +- +- +

Input model

Page 14: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

14

User Input: Signature Characteristics

Marking signature characteristics

- +Enlarge Scale

- +Enlarge Scale

Input model

- +Stretch Scale

- +Stretch Scale

Input model

Page 15: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

15

Skeleton

TemplateBaran et al. SIGGRAPH2007

Page 16: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

16

Overview

Optimization-based approach

Input model & skeleton Deformed skeleton

SkeletonDeformation

MeshDeformation

Output model

Page 17: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

17

Skeleton Deformation

Page 18: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

18

Skeleton Deformation

Page 19: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

19

Mesh Deformation

Body proportion constraint Signature characteristic constraint Primitive fitting constraint Detail smoothing constraint

Total energy and optimization

Page 20: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

20

Body Proportion

Page 21: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

21

Signature Characteristic

Emphasizing along Skeleton Axes

Page 22: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

22

Signature Characteristic

Emphasizing along Skeleton Orthogonal Directions

Page 23: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

23

Primitive Fitting

Fitting head to a sphere

Page 24: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

24

Primitive Fitting

Fitting limbs to a capsule shape

Page 25: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

25

Detail Smoothing

Page 26: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

26

Total Energy and Optimization

Page 27: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

27

Result

Input model

Different body proportion parameters

Page 28: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

28

Result

Input model

Different body proportion parameters

Page 29: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

29

Result

25273 vertices, 16.287 seconds

Page 30: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

30

Result

4712 vertices, 2.48 seconds

Page 31: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

31

Result

1480 vertices, 0.749 seconds

Page 32: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

32

Result

5000 vertices, 2.527 seconds

Page 33: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

33

Comparison

Input model Body-part uniformly scaling

Our methodArtist hand crafted

Page 34: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

34

User Study

47 users 12 input models

Page 35: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

35

User Study

How cute? 1(Negative) 5(Positive) Are the SD counterparts cuter than the

original model? Which head proportion is cuter?

Input model3.55423

Page 36: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

36

Limitation

Correctly embedded skeleton Self-intersections and vertex sampling density Texture

Page 37: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

37

Conclusion

Optimization-based technique Semi-automatically create a character model

with the SD style Customization

Parameters with body proportion Signature

Page 38: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

38

Future Work

Solving texture distortion Texture stylization

Page 39: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

39

Acknowledgments

We thank the anonymous reviewers for their thoughtful suggestions, and also thank Digimax and SolidWorks for providing high quality character models. We also thank Sei Imai for designing The cartoon character Hatsune Miku’s SD version. This research was supported in part by the National Science Council of Taiwan under grant NSC101-2221-E-002-200-MY2.

Page 40: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University.

40

SD Models: Super-Deformed Character ModelsLiang-Tsen Shen, Sheng-Jie Luo, Chun-Kai Huang, and Bing-Yu Chen

Thank you!Additional materials: http://www.cmlab.csie.ntu.edu.tw/~forestking/research/PG12-SDModel/