Learning to Compute the Symmetry Plane for Human Faces Jia Wu ([email protected]) ACM-BCB '11, August...

26
Learning to Compute the Symmetry Plane for Human Faces Jia Wu ([email protected]) ACM-BCB '11, August 2011 1
  • date post

    19-Dec-2015
  • Category

    Documents

  • view

    213
  • download

    0

Transcript of Learning to Compute the Symmetry Plane for Human Faces Jia Wu ([email protected]) ACM-BCB '11, August...

Page 1: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

1

Learning to Compute the Symmetry Plane for Human Faces

Jia Wu ([email protected])ACM-BCB '11, August 2011

Page 2: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

3

Landmark by medical experts

Landmarks labeled by experts

Standard symmetry plane

Page 3: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

4

Flow chart for training

Landmarks from medical experts

Landmark model training

Points predicted as interesting regions Connected regions

Standard symmetry plane

Symmetry model training

Page 4: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

5

10 kinds of landmarks.

– Nose: ac (nose side), prn, sn,se

– Eyes: en, ex– Mouth: (li,ls), ch,

sto– Chin: slab

Page 5: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

6

Positive/negative samples

Training for en: the inner corners of the eyes

Training for prn: most protruded point of nasal tip

Page 6: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

7

Features: mean and Gaussian curvatures for original head and smoothed head

Page 7: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

8

Flow chart

Landmarks from medical experts

Landmark model training

Points predicted as interesting Connected regions

Standard symmetry plane

Symmetry model training

Page 8: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

9

Interesting points prediction

Prediction of en: the inner corners of the eyes

Prediction of prn: most protruded point of nasal tip

Page 9: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

10

Connected regions

Connected regions for en: each color means one region

Connected regions for prn: each color means one region

Page 10: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

11

Flow chart

Landmarks from medical experts

Landmark model training

Points predicted as interesting regions Connected regions

Standard symmetry plane

Symmetry model training

Page 11: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

12

How to define “good” symmetric regions• A “good” pair of regions should be symmetric to the standard

symmetry plane• A “good” single region should have the center on the standard

symmetry plane

“good” regions for en “good” regions for prn

Page 12: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

13

Feature for regions

Principal component analysis and eigenvalues

Page 13: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

14

Flow chart for training

Landmarks from medical experts

Landmark model training

Points predicted as interesting regions Connected regions

Standard symmetry plane

Symmetry model training

Page 14: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

15

Procedure for New dataSelect possible landmark

areas( from Landmark model)

Find and pair connected regions

Determine good singles and good pairs ( from Symmetry model)

Get center and draw a plane using learned centers

interesting regions for prn

Predicted as good single

Predicted as good pair

Page 15: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

16

Procedure for New Images

Centers of good regions Centers for constructing plane of symmetry Result: Plane of symmetry

Page 16: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

17

Experiments

• Compare the plane of symmetry to– Ground truth (plane determined by expert labeled

landmarks)– Mirror method in literature

• Ground truth dataset 1• Ground truth dataset 2• Cleft dataset

Page 17: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

18

Mirror method in literature

Page 18: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

19

Results compare to ground truth

• Yellow: overlapping with ground truth• Green: ground truth• Purple: extra from each method

our methodAngle:4.03˚

mirror methodAngle:2.15˚

Page 19: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

20

Results compare to ground truth

• Yellow: overlapping with ground truth -> true positive• Green: ground truth -> false negative• Purple: extra from each method -> false positive

our method mirror method

Page 20: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

21

best

worst

worst

best

Page 21: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

22

Ground truth dataset 2

1 2 3 4 5

6 7 8 9 10

Page 22: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

23

0 30 60 90

0

1 2 4 7

30

3 5 8 11

60

6 9 12 14

90

10 13 15 16

Page 23: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

24

best

worst

worst

best

Page 24: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

25

Page 25: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

26

Cleft dataset

Learning method

Mirror method

Page 26: Learning to Compute the Symmetry Plane for Human Faces Jia Wu (jiawu@uw.edu) ACM-BCB '11, August 2011 1.

27

Questions?