Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer,...

19
Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer and Information Science University of Ljubljana, Slovenia

Transcript of Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer,...

Page 1: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Human Skin Colour Clustering for Face

Detection

“15 Seconds of Fame”

Jure Kovač, Peter Peer, Franc Solina

Computer Vision LaboratoryFaculty of Computer and Information ScienceUniversity of Ljubljana, Slovenia

Page 2: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

“In the future everybody will be famous for 15 minutes.”

Andy Warhol

Marilyn Monroe (Andy Warhol, 1964)

Application Contribution Skin models Tested using our

algorithm Purpose

Page 3: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

An interactive art installation 15 second of fame

Page 4: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Hardware

Digital camera LCD monitor

computer

USB

Page 5: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Software

input photo

finding faces

transformation color filter

pop-art portrait

illumination compensation learning

15 second loop

Page 6: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Roadmap

Face detection algorithm Skin labeling approaches Illumination compensation

approaches Pop-art color transformations Summary

Page 7: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Face detection method #1Our original face detection method

Page 8: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Face detection method #2Simplified face detection method

Page 9: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Skin labeling approaches #1

Our modelin RGB colour space

Page 10: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Skin labeling approaches #2

Model #1in UV colour space

Hsu et al(TPAMI’02)

Cb Cr

Y Y

Page 11: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Skin labeling approaches #3

Model #2in UV colour space

Hsu et al(TPAMI’02)

Cb

Cr

Page 12: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Skin labeling approaches #4 –Results #1

Page 13: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Skin labeling approaches #4 –Results #2

Page 14: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Skin labeling approaches #4 –Results #3

Page 15: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Eliminating the influence of non-standard illumination

Grey World Modified Grey World White-Patch Retinex

Color by Correlation

Page 16: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Color transformations

+ color-balance

+ random coloring

+ posterize+ hue-saturation

+ color-balance+ posterize+ hue-saturation

= 17 universal filters

Different displayingE-mail ordering of portraits

Page 17: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

Conclusions

Graz (Austria), Zagreb (Croatia) Leonardo (MIT Press) Rent/Buy

For our detection scheme the 3D Color space proved better!!!

The people accepted application very well

Page 18: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

The gallery of famous people

from the project web page: black.fri.uni-lj.si/15sec

Page 19: Human Skin Colour Clustering for Face Detection “15 Seconds of Fame” Jure Kovač, Peter Peer, Franc Solina Computer Vision Laboratory Faculty of Computer.

The first public showing