Computer vision fundamentals of computer vision - mubarak shah - allbookfree.tk
High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for...
Transcript of High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for...
![Page 1: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/1.jpg)
High Level Computer Vision
Deep Learning for Computer Vision Part 3 - Segmentation
Bernt Schiele - [email protected] Mario Fritz - [email protected]
https://www.mpi-inf.mpg.de/hlcv
![Page 2: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/2.jpg)
High Level Computer Vision - July 15, 2o15
• From detection to segmentation ‣ Main Reading:
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs, Chen, Papandreou, Kokkins, Murphy, Yuille, ICLR’15
‣ Further interesting reading - Hypercolumns for object segmentation and fine-grained localization
Bharath Hariharan, Pablo Arbeláez, Ross Girshick, Jitendra Malik, CVPR’15 - Fully Concolutional Networks for Semantic Segmentation
John Long, Evan Shelhamer, Trevor Darelle, CVPR’15
2
![Page 3: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/3.jpg)
High Level Computer Vision - July 15, 2o15 3
![Page 4: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/4.jpg)
High Level Computer Vision - July 15, 2o15 4
![Page 5: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/5.jpg)
High Level Computer Vision - July 15, 2o15 5
![Page 6: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/6.jpg)
Sliding Window with ConvNet
Input Window
224
224
66
256C
classes
Conv Conv Conv Conv Conv Full Full
Feature Extractor Classifier
![Page 7: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/7.jpg)
Sliding Window with ConvNet
Input Window
224 6256
Conv Conv Conv Conv Conv Full Full
Feature Extractor167
240
1
No need to compute two separate windowsJust one big input window, computed in a single pass
C classes
![Page 8: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/8.jpg)
High Level Computer Vision - July 15, 2o15 8
![Page 9: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/9.jpg)
High Level Computer Vision - July 15, 2o15 9
![Page 10: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/10.jpg)
High Level Computer Vision - July 15, 2o15 10
![Page 11: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/11.jpg)
High Level Computer Vision - July 15, 2o15 11
![Page 12: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/12.jpg)
High Level Computer Vision - July 15, 2o15 12
![Page 13: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/13.jpg)
High Level Computer Vision - July 15, 2o15
“Hole” algorithm
• skip subsampling ‣ in their case for VGG-net: after the last two max-pooling layers)
• for the next layer filter: sparsely sample the feature map with “input stride” 2 (or 4 respectively)
13
![Page 14: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/14.jpg)
High Level Computer Vision - July 15, 2o15 14
![Page 15: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/15.jpg)
High Level Computer Vision - July 15, 2o15
CRF - Conditional Random Field
• Energy function to be minimized
‣ with unary terms obtained from the CNN:
‣ and pairwise terms (Potts model)
- with
15
![Page 16: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/16.jpg)
High Level Computer Vision - July 15, 2o15 16
![Page 17: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/17.jpg)
High Level Computer Vision - July 15, 2o15 17
![Page 18: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/18.jpg)
High Level Computer Vision - July 15, 2o15 18
![Page 19: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/19.jpg)
High Level Computer Vision - July 15, 2o15 19
![Page 20: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/20.jpg)
High Level Computer Vision - July 15, 2o15 20
![Page 21: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/21.jpg)
High Level Computer Vision - July 15, 2o15
Another fully convolutional network for semantic segmentation (without CRF)
21
![Page 22: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/22.jpg)
High Level Computer Vision - July 15, 2o15 22
![Page 23: High Level Computer Vision Deep Learning for …...High Level Computer Vision Deep Learning for Computer Vision Part 3 - Segmentation Bernt Schiele - schiele@mpi-inf.mpg.de Mario Fritz](https://reader030.fdocuments.in/reader030/viewer/2022040214/5ec67d6a8fda4a7c6a3c9b29/html5/thumbnails/23.jpg)
High Level Computer Vision - July 15, 2o15 23