Object Detection20170930... · What is an Object Detection? Find a target object in an given image....
Transcript of Object Detection20170930... · What is an Object Detection? Find a target object in an given image....
![Page 1: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/1.jpg)
Presenter: Dae-Yong
Object Detection
Part1
![Page 2: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/2.jpg)
Contents
1. What is an Object Detection?
2. Traditional Object Detector
3. Deep Learning-based Object Detector
![Page 3: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/3.jpg)
What is an Object Detection?
Subset of Object Recognition
![Page 4: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/4.jpg)
What is an Object Detection?
Scene Categorization
Urban/Intersection
Object Segmentation
Object Categorization(Classification)
Car Pedestrian Bus Tree
Object Detection
CarCar
Car
Bus
Ped
Object Recognition
![Page 5: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/5.jpg)
What is an Object Detection?
Find a target object in an given image.
Input Output
Image Sequence
Car Car
Car
Bus
Ped
- Object Class- Object Location(x, y, width, height)
3 Channels, 2D matrices
x
y 1. Car, (0, 250, 120, 125)2. Car, (80, 256, 60, 40)3. Car, (140, 245, 130, 120)4. Pedestrian, (400, 247, 20, 70)5. Bus, (520, 0, 110, 320)
R
G
B
![Page 6: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/6.jpg)
How can we know where objects are and what they are?
- Traditional approach
- Deep Learning-based approach
Object Detection
Input Image
Feature Extraction
Candidate Generation
ClassificationDetection Output
Deep Neural NetworkInput Image
Detection Output
![Page 7: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/7.jpg)
Traditional Object Detection
![Page 8: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/8.jpg)
Traditional Object Detection
Input Image
Feature Extraction
Candidate Generation
ClassificationDetection Output
Target Object
![Page 9: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/9.jpg)
Traditional Object Detection
Input Image
Feature Extraction
Candidate Generation
ClassificationDetection Output
Target Object
![Page 10: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/10.jpg)
Traditional Object Detection
Input Image
Feature Extraction
Candidate Generation
ClassificationDetection Output
Target Object
![Page 11: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/11.jpg)
Traditional Object Detection
Input Image
Feature Extraction
Candidate Generation
ClassificationDetection Output
Sliding window
“Image Pyramid”Siz
eScale
![Page 12: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/12.jpg)
Traditional Object Detection
Input Image
Feature Extraction
Candidate Generation
ClassificationDetection Output
Pedestrian
![Page 13: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/13.jpg)
Traditional Object Detection
Input Image
ClassificationDetection Output
Candidate Generation
Feature Extraction
[Candidate Generation]
- Sliding Window Search
- Selective Search
- Multiscale Combinatorial Grouping (MCG)
- Edge-Box
- Binarized Normed Gradient (BING)
[Feature Extraction]
- Color / Brightness / Gradient
- Haar Feature
- Scale Invariant Feature Transform(SIFT)
- Local Binary Pattern(LBP)
- Histogram Oriented Gradient(HOG)
HOG
Gradient
Object Proposal
![Page 14: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/14.jpg)
Traditional Object Detection
Input Image
ClassificationDetection Output
Candidate Generation
Feature Extraction
[Classification]
- AdaBoost
- Random Forest
- Support Vector Machine (SVM)
- Latent Support Vector Machine (L-SVM)
![Page 15: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/15.jpg)
Traditional Object Detection (Demo)
Target Object: REAR Vehicle
Feature: LBP Classifier: Cascade Classifier
![Page 16: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/16.jpg)
Deep Learning-based Object Detection
![Page 17: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/17.jpg)
Deep Learning-based Object Detection
Input Image
Deep Neural Network(Classification)
Detection Output
Candidate Generation
Apply image classification network to each object candidates
Input image
Generate object candidates
Image Classification (AlexNet)
Car
BusDetection Output
1
2
3
4
Regions with CNN features (R-CNN), 2013
![Page 18: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/18.jpg)
Deep Learning-based Object Detection
How convolutional neural network is worked on the image?
Conv. Filter
Input Image
1st Feature Map
2nd Feature Map
Conv. Filter
![Page 19: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/19.jpg)
Deep Learning-based Object Detection
Fast Region-based Conv. Neural Net. (Fast R-CNN), April, 2015
Computational cost is proportionally increasedaccording to the number of candidates.
Input image
Generate object candidates
Image Classification (AlexNet)
Car
BusDetection Output
1
2
3
4
ROI Projection
Deep Conv Net. ROI PoolingFully Conn.
Input Image
Deep Neural Network(Classification)
Detection Output
Candidate Generation
![Page 20: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/20.jpg)
Base model: AlexNet / VGG
Deep Learning-based Object Detection
Input Image
Deep Neural NetworkDetection Output
Input image
Car
BusDetection Output1
2
3
Deep Conv Net.
ROI Pooling Fully Conn.
Faster Region-based Conv. Neural Net. (Faster R-CNN), June, 2015
Feature Maps
Region Proposal Net.
![Page 21: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/21.jpg)
Deep Learning-based Object Detection
You Only Look Once (YOLO)
Single Shot MultiBox Detector (SSD)
![Page 22: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/22.jpg)
Design Basic Object Detector- Feature: HOG Features- Classification: SVM- Practice with toy example
Next Presentation
Part2: Traditional Object Detection from Scratch
Part3: Deep Learning-based Object Detection I
?
Part4: Deep Learning-based Object Detection II
?
![Page 23: Object Detection20170930... · What is an Object Detection? Find a target object in an given image. Input Output Image Sequence Car Car Car Bus Ped - Object Class - Object Location(x,](https://reader034.fdocuments.in/reader034/viewer/2022042915/5f532065822506552d3581ac/html5/thumbnails/23.jpg)