Detecting Pedestrians by Learning Shapelet Features
description
Transcript of Detecting Pedestrians by Learning Shapelet Features
![Page 1: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/1.jpg)
1
Detecting Pedestrians by Learning Shapelet Features
Payam Sabzmeydani and Greg MoriVision and Media Lab
School of Computing Science
Simon Fraser University
![Page 2: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/2.jpg)
2
Problem Given a still image, we want to find and locate
the pedestrians in the image Clothing (color, appearance) Body pose
Applications: Automated surveillance systems Image search and retrieval Robotics Intelligent vehicles
![Page 3: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/3.jpg)
3
Problem
![Page 4: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/4.jpg)
4
Problem Classification-based detection
Classify a window as pedestrian or non-pedestrian Search exhaustively the scale-space image
Different cues Wavelet coefficients (Mohan et al., PAMI 2001) Oriented gradients (Dalal and Triggs, CVPR 2005) SIFT features (Leibe et al., CVPR 2005) Edgelet features (Wu and Nevatia, ICCV 2005) “Shapelet features” (Sabzmeydani and Mori, CVPR 2007)
![Page 5: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/5.jpg)
5
Datasets MIT : Standing pose, simple background, no occlusion
INRIA : Standing pose, complex background, partial occlusions
![Page 6: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/6.jpg)
6
Previous Work Dalal & Triggs (CVPR 2005)
HOG features + SVM
![Page 7: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/7.jpg)
7
Previous Work Wu & Nevatia (ICCV 2005)
Edgelet features: short line and curve segments AdaBoost
![Page 8: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/8.jpg)
8
Our Method
Compute low-level gradient features Oriented filter responses
Learn mid-level features for detecting pedestrians “Shapelet features”
Build final classifier from shapelet features
![Page 9: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/9.jpg)
9
Low-level Features Filter responses
Image gradient in different directions
![Page 10: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/10.jpg)
10
Low-level Features Smoothed gradient responses in different
directions
![Page 11: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/11.jpg)
11
Shapelet Features A weighted set of low-level gradient features
inside a sub-window of the detection window Characteristics
Simple and low-dimensional Learned exclusively for our object classes Highly discriminative Local effective area : useful to model separate parts
instead of the whole body
![Page 12: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/12.jpg)
12
Shapelet Features
![Page 13: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/13.jpg)
13
Learning Shapelet Features Learned using AdaBoost (Viola and Jones,
2001) Extract low-level features in sub-window Select subset of features using AdaBoost
Find those which discriminate between pedestrian and background classes
![Page 14: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/14.jpg)
14
AdaBoost Algorithm
W
w
![Page 15: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/15.jpg)
15
Low-level features as weak classifiers Each low-level feature can provide us many
weak classifiers:
AdaBoost will combine weak classifiers to form a better classifier:
![Page 16: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/16.jpg)
16
Shapelet features Train classifiers in sub-windows Use the output of a classifier as the shapelet
feature response:
![Page 17: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/17.jpg)
17
Shapelet Features
![Page 18: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/18.jpg)
18
Shapelet Features
![Page 19: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/19.jpg)
19
Final Classifier Take all shapelet features
Learned at many sub-windows of detection window
Run AdaBoost again to select weighted subset of shapelet features for final classifier
![Page 20: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/20.jpg)
20
Final Classifier
![Page 21: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/21.jpg)
21
Shapelet Feature Size Small, Medium, and Large features
Capture different scales of information
![Page 22: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/22.jpg)
22
Why normalize? Different lighting, shadows, different contrast, …
How to normalize? Per shapelet feature : L2-norm
Normalization
![Page 23: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/23.jpg)
23
Normalization
![Page 24: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/24.jpg)
24
Results on INRIA Dataset
![Page 25: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/25.jpg)
25
Most non-pedestrian-like pedestrians (false negatives)
Most pedestrian-like non-pedestrians (false positives)
Error examples
![Page 26: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/26.jpg)
26
Future work
Detecting other objects Use image context or segmentation Pyramid of features
![Page 27: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/27.jpg)
27
![Page 28: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/28.jpg)
28
References N. Dalal and B. Triggs. “Histograms of oriented
gradients for human detection”. CVPR 2005. B. Wu and R. Nevatia. “Detection of multiple, partially
occluded humans in a single image by bayesian combination of edgelet part detectors”. ICCV 2005.
P. Viola and M. Jones. “Rapid object detection using a boosted cascade of simple features”. SCTV 2001.
![Page 29: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/29.jpg)
29
Problem
![Page 30: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/30.jpg)
30
Problem
![Page 31: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/31.jpg)
31
Bootstrapping
![Page 32: Detecting Pedestrians by Learning Shapelet Features](https://reader036.fdocuments.in/reader036/viewer/2022062500/56815223550346895dc068a3/html5/thumbnails/32.jpg)
32
Mid-level Features