Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks...

54
Deep Networks Vittal Premachandran

Transcript of Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks...

Page 1: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Deep NetworksVittal Premachandran

Page 2: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Supervised Learning y=f(x)● Binary Classification:

○ Given x find y ∊ {-1, 1}● Multiclass Classification

○ Given x find y ∊ {1,...,k}● Regression

○ Given x find y ∊ R (or, Rd)

Page 3: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 4: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 5: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

Page 6: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

Page 7: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

Page 8: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF

Page 9: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSER

Page 10: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSERTextons

Page 11: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSERTextons

GLOH

Page 12: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSERTextons

GLOH

Color-SIFT

Page 13: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSERTextons

GLOH

Color-SIFT

SPIN

Page 14: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSERTextons

GLOH

Color-SIFT

SPIN

PHOG

Page 15: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

SIFT

HOG

LBP

SURF MSERTextons

GLOH

Color-SIFT

SPIN

PHOG

...

Page 16: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

W T F

Page 17: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Which

Training

Features to use?

Page 18: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Can we learn the features (internal representations)?

Page 19: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 20: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 21: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 22: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 23: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 24: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 25: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 26: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 27: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 28: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 29: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 30: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 31: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 32: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 33: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 34: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 35: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Convolutional Neural Networks

Page 36: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 37: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 38: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 39: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 40: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 41: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 42: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 43: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 44: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 45: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 46: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 47: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 48: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 49: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 50: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Alex Net

Krizhevsky et al. NIPS 2012

Page 51: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 52: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 53: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face
Page 54: Deep Networks - Department of Computer Scienceayuille/courses/Stat271-Fall15/Deep Networks Vitta… · Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face

Anti-Makeup: Learning A Bi-Level Adversarial Network for ... · The Deepface architecture was expounded in (Taigman et al. 2014) to effectively leverage a very large labeled dataset

Anti-Makeup: Learning A Bi-Level Adversarial Network for ... · The Deepface architecture was expounded in (Taigman et al. 2014) to effectively leverage a very large labeled dataset

Relative luminance and binocular disparity preferences are ...ayuille/courses/Stat271-Fall13/PNAS-2012-Samond… · Relative luminance and binocular disparity preferences are correlated

Relative luminance and binocular disparity preferences are ...ayuille/courses/Stat271-Fall13/PNAS-2012-Samond… · Relative luminance and binocular disparity preferences are correlated

Leveraging Billions of Faces to Overcome Performance ... · Leveraging Billions of Faces to Overcome Performance Barriers in Unconstrained Face Recognition Yaniv Taigman and Lior

Leveraging Billions of Faces to Overcome Performance ... · Leveraging Billions of Faces to Overcome Performance Barriers in Unconstrained Face Recognition Yaniv Taigman and Lior

1 In - Department of Computer Scienceayuille/PubsJournal/J48ZhuYuille96.pdf · 2016. 8. 5. · alb edo of material. This a v oids k ey dra wbac man y approac hes to image segmen tation

1 In - Department of Computer Scienceayuille/PubsJournal/J48ZhuYuille96.pdf · 2016. 8. 5. · alb edo of material. This a v oids k ey dra wbac man y approac hes to image segmen tation

Beyond Frontal Faces: Improving Person Recognition Using ... · Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues Ning Zhang1, Manohar Paluri 2, Yaniv Taigman

Beyond Frontal Faces: Improving Person Recognition Using ... · Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues Ning Zhang1, Manohar Paluri 2, Yaniv Taigman

Introduction to Visionayuille/courses/Stat271-Fall15/IntroLectureLeo2014... · Alan L. Yuille. UCLA. IPAM Summer School 2013 3 weeks of online lectures on Vision. “What papers do

Introduction to Visionayuille/courses/Stat271-Fall15/IntroLectureLeo2014... · Alan L. Yuille. UCLA. IPAM Summer School 2013 3 weeks of online lectures on Vision. “What papers do

DAS-FACE · 2018. 7. 12. · 3] Taigman, Y., Yang, M., Ranzato, M. & Wolf, L. “Deepface: closing the gap to human-level performance in face verification”. Proc. Conference on

DAS-FACE · 2018. 7. 12. · 3] Taigman, Y., Yang, M., Ranzato, M. & Wolf, L. “Deepface: closing the gap to human-level performance in face verification”. Proc. Conference on

A Universal Music Translation Network - arxiv.org · A Universal Music Translation Network Noam Mor, Lior Wolf, Adam Polyak, Yaniv Taigman Facebook AI Research Abstract We present

A Universal Music Translation Network - arxiv.org · A Universal Music Translation Network Noam Mor, Lior Wolf, Adam Polyak, Yaniv Taigman Facebook AI Research Abstract We present

Deep Learning based FACS Action Unit Occurrence and ... · in solving such facial semantic feature recognition tasks. A recent work for facial recognition by Taigman et al. [11] has

Deep Learning based FACS Action Unit Occurrence and ... · in solving such facial semantic feature recognition tasks. A recent work for facial recognition by Taigman et al. [11] has

Inferential Models of the Visual Cortical Hierarchy*ayuille/courses/Stat271-Fall13/KerstenYu...In all three fields, theories of representations of visual knowledge and the processes

Inferential Models of the Visual Cortical Hierarchy*ayuille/courses/Stat271-Fall13/KerstenYu...In all three fields, theories of representations of visual knowledge and the processes

Image parsing mechanisms of the visual cortexayuille/courses/Stat271-Fall13/VonderHeydt_Image... · R. von der Heydt: Image Parsing Mechanisms of the Visual Cortex 2 1. Introduction

Image parsing mechanisms of the visual cortexayuille/courses/Stat271-Fall13/VonderHeydt_Image... · R. von der Heydt: Image Parsing Mechanisms of the Visual Cortex 2 1. Introduction

Lecture 7 - Department of Computer Scienceayuille/courses/Stat238-Winter12/Lecture7(2012).pdf · For image segmentation a typical a nity between pixels i and j is de ned by wij =

Lecture 7 - Department of Computer Scienceayuille/courses/Stat238-Winter12/Lecture7(2012).pdf · For image segmentation a typical a nity between pixels i and j is de ned by wij =

Manhattan World - Department of Computer Scienceayuille/pubs/ucla/A179_jcoughlan_NC2003.pdf · Manhattan World James Coughlan Smith-Kettlewell Eye Research Institute San Francisco,

Manhattan World - Department of Computer Scienceayuille/pubs/ucla/A179_jcoughlan_NC2003.pdf · Manhattan World James Coughlan Smith-Kettlewell Eye Research Institute San Francisco,

Advancing Despite Adversity - FirstWatch€¦ · ©2019 Hello Driven Pty Ltd Advancing Despite Adversity Presented By: Jurie Rossouw, CEO of Driven Mike Taigman, Improvement Guide

Advancing Despite Adversity - FirstWatch€¦ · ©2019 Hello Driven Pty Ltd Advancing Despite Adversity Presented By: Jurie Rossouw, CEO of Driven Mike Taigman, Improvement Guide

Multiple One-Shots for Utilizing Class Label Information€¦ · 4 TAIGMAN: MULTIPLE ONE-SHOTS FOR UTILIZING CLASS LABEL INFORMATION. A note regarding complexity. Two classifiers

Multiple One-Shots for Utilizing Class Label Information€¦ · 4 TAIGMAN: MULTIPLE ONE-SHOTS FOR UTILIZING CLASS LABEL INFORMATION. A note regarding complexity. Two classifiers

Introduction to Retinaayuille/courses/Stat271-Fall15/RetinaIntroduction.pdf · Purpose of the Retina • The anatomy and electrophysiology of the retina has been studied extensively

Introduction to Retinaayuille/courses/Stat271-Fall15/RetinaIntroduction.pdf · Purpose of the Retina • The anatomy and electrophysiology of the retina has been studied extensively

Cue Coupling - Department of Computer Scienceayuille/courses/Stat271-Fall15/BasicCueCoupling.pdfCue Coupling This section describes models for coupling di erent visual cues. The ideas

Cue Coupling - Department of Computer Scienceayuille/courses/Stat271-Fall15/BasicCueCoupling.pdfCue Coupling This section describes models for coupling di erent visual cues. The ideas

1 Unsupervised Generation of Free-Form and Parameterized ... · 1 Unsupervised Generation of Free-Form and Parameterized Avatars Adam Polyak, Yaniv Taigman, and Lior Wolf, Member,

1 Unsupervised Generation of Free-Form and Parameterized ... · 1 Unsupervised Generation of Free-Form and Parameterized Avatars Adam Polyak, Yaniv Taigman, and Lior Wolf, Member,

Supplementary Material: DeepFace: Closing the Gap to Human … · 2014-04-21 · DeepFace: Closing the Gap to Human-Level Performance in Face Verification Yaniv Taigman Ming Yang

Supplementary Material: DeepFace: Closing the Gap to Human … · 2014-04-21 · DeepFace: Closing the Gap to Human-Level Performance in Face Verification Yaniv Taigman Ming Yang

NaturalversusSyntheticStimuliforEstimatingReceptive ...ayuille/courses/Stat271-Fall13/curtis_baker_v1RF.pdfframerefresh,withmeanluminancemaintainedbetweenpresentations. Other types

NaturalversusSyntheticStimuliforEstimatingReceptive ...ayuille/courses/Stat271-Fall13/curtis_baker_v1RF.pdfframerefresh,withmeanluminancemaintainedbetweenpresentations. Other types