EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of...

25
EECS 274 Computer Vision Object detection

Transcript of EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of...

Page 1: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

EECS 274 Computer Vision

Object detection

Page 2: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Human detection

• HOG features• Cue integration• Ensemble of classifiers• ROC curve

• Reading: Assigned papers

Page 3: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Human detection with HOG

• Histogram of oriented gradients

• Using local gradients to represent positive and negative examples

Page 4: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Histogram of oriented gradients

Page 5: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

HOG descriptors

Page 6: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results with MIT dataset

Page 7: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results with INRIA dataset

Page 8: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Parameter sweeping

Page 9: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Block/cell size

Page 10: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results

Page 11: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Observations

• No gradient smoothing with [-1,0,1] derivative filter

• Use gradient magnitude (no thresholding)

• Orientation voting into fine bins• Spatial voting into coarser bins• Strong local normalization• Overlapping normalization blocks

Page 12: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Cal Tech Pedestrian DatasetA large annoated dataset with performance evaluation

Page 13: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Performance evaluation

Page 14: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results (cont’d)

Page 15: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results (cont’d)

Page 16: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results (cont’d)

Page 17: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results (cont’d)

Page 18: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Summary

• HOG, MultiFtr, FtrMine outperform others

• VJ and Shaplet perform poorly• LatSvm trained on PASCAL dataset• HOG poerforms best on near,

unoccluded pedestrians• MultiFtr ties or outperforms HOG on

difficult cases• Much room for imporvment

Page 19: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Daimler dataset

• Recent survey in PAMI 09• Observation

– HOG/linSVM at higher image resolution performs well, with lower processing speed)

– Wavelet-based Adaboost cascade at lower image resolution performs well, with higher processing speed

Page 20: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Neural network with receptive fields

Page 21: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Results

Page 22: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Cue integration

Multi-cue pedestrian detection and tracking from a moving vehicle, IJCV 06

Page 23: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Classifier ensemble

• Cascade of boosted classifiers• Variable-size blocks: 12 x 12, 64 x 128,

etc. 5031 blocks in 64 x 128 image patch

Fast human detection using a cascade of histograms of oriented gradients, CVPR 06

Page 24: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Classifier ensemble

An HOG-LBP Human Detector with Partial Occlusion Handling, ICCV 09

Page 25: EECS 274 Computer Vision Object detection. Human detection HOG features Cue integration Ensemble of classifiers ROC curve Reading: Assigned papers.

Convert holistic classifier to local-classifier ensemble

An HOG-LBP Human Detector with Partial Occlusion Handling, ICCV 09

?