Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member,...

20
Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih- Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 21, NO. 4, APRIL 2012

description

Introduction These technologies have a variety of applications, such as military,police, and traffic management. Aerial surveillance is more suitable for monitoring fast-moving targets and covers a much larger spatial area.

Transcript of Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member,...

Page 1: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Vehicle Detection in Aerial Surveillance Using

Dynamic Bayesian NetworksHsu-Yung Cheng, Member, IEEE, Chih-Chia

Weng, and Yi-Ying ChenIEEE TRANSACTIONS ON IMAGE

PROCESSING, VOL. 21, NO. 4, APRIL 2012

Page 2: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Goal

Page 3: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Introduction

• These technologies have a variety of applications, such as military,police, and traffic management.

• Aerial surveillance is more suitable for monitoring fast-moving targets and covers a much larger spatial area.

Page 4: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Introduction

• Cheng and Butler [8] performed color segmentation via mean-shift algorithm and motion analysis via change detection.

• In [11], the authors proposed a moving-vehicle detection method based on cascade classifiers.

• Choi and Yang [12] proposed a vehicle detection algorithm using the symmetric property of car shapes.

Page 5: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Introduction

Page 6: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Background Color Removal

• quantize the color histogram bins as 16*16*16.

• Colors corresponding to the first eight highest bins are regarded as background colors and removed from the scene.

Page 7: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Feature Extraction:Local Feature Analysis

Page 8: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Feature Extraction:Local Feature Analysis

Page 9: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Feature Extraction:Local Feature Analysis

• After evaluation, is known.

• Use the gradient magnitude G(x,y) of each pixel of moment-preserving.

• Tmax =T ,Tmin=0.1*(Gmax-Gmin) for Canny edge detector.

• Harris detector is for the corners.

Page 10: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Feature Extraction:Color Transform and Color Classification• In [16],they proposed a color domain (u,v)

instead of (R,G,B) to separate vehicle and non-vehicle pixels clearily.

• Use n*m as a block to train SVM model to classify color.

Page 11: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Feature Extraction:Color Transform and Color Classification

Page 12: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Feature Extraction

• We extract five types of features, S,C,E,A and Z for the pixel.

• A=L/W• Z=blue counts at left

Page 13: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Dynamic Bayesian Network

• Use some videos to train the probabilities with people marked ground truth.

• Vt indicates if a pixel belongs to a vehicle.

• P(Vt|St) is defined as the probability that a pixel belongs to a vehicle pixel at time slice given observation St at time Instance t.

Page 14: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results

Page 15: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results

Page 16: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results

Page 17: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results

Page 18: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results

Page 19: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results

Page 20: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS.

Experimental results