Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University...
Transcript of Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University...
![Page 1: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/1.jpg)
Vehicle Detection withSatellite Images
Presented by
Prem K. Goel
NCRST-F, The Ohio State University
Workshop on
Satellite Based Traffic Measurement
Berlin, Germany
9-10 September 2002
![Page 2: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/2.jpg)
Image Processing Algorithms: Performance Evaluation
Acknowledgment C. Merry, G. Sharma, F. Lu,
M. McCord,
Past students: P. Goel, and J. Gardar
![Page 3: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/3.jpg)
Vehicle Identification in High Resolution Satellite Imagery
• Infrequent Image Acquisition from satellites
• Stereo Coverage May be Unavailable
![Page 4: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/4.jpg)
IKONOS Satellite Imagery: Tucson, AZ
![Page 5: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/5.jpg)
Zooming-in
![Page 6: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/6.jpg)
![Page 7: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/7.jpg)
![Page 8: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/8.jpg)
Image Segment for Processing
![Page 9: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/9.jpg)
Zoomed and Pan Satellite Imagery (Columbus)
![Page 10: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/10.jpg)
Problem Statement
• 1-m resolution image• 8 or 11-bit data• To detect and count
vehicles• Vehicle classes – cars
and trucks• No road detection
![Page 11: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/11.jpg)
Pavement Background Image
• Lack of stereo Images
• Background (Pavement) Image
• No Background
• Background Based•Bayesian Background Transformation (BBT)•Principal Components (PCA)
•Gradient Based
![Page 12: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/12.jpg)
BBT Method: Flow Chart
Update probabilities
Highway Image (I) Background (B)
Background Transform
Estimate Distribution Parameters
Threshold
Clustering and other operations
Vehicle Counts
Converged?
Yes
No
•Estimate probability of a pixel being stationary based on change from background
Distributions of gray-levels in two classesInitial prior probabilities
![Page 13: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/13.jpg)
Principal Components (PCA) Method
Principal Components Analysis
Binary Image
Vehicle counts
Roadway only Image (I) Background (B)
S = I + B
D = |I – B|
V1=Var2x2(S)
M1= Mean2x2(S) M2= Mean2x2(D)
V2=Var2x2(D)
Select PC Band. Threshold
Clustering and other operations
PC Bands 1-4
PCA-based Method•Bands to capture texture and change•Re-orient bands
![Page 14: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/14.jpg)
Segmented Highway Image (I)
Calculate Gradient Image
Threshold
Morphological operations and Clustering
Vehicle counts
Gradient Based Method•The ‘edge’ at vehicle boundaries•Gradient image = image with two classes
Threshold-try to incorporate spatial distribution of gray values
Gradient based method
![Page 15: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/15.jpg)
OriginalImage
Binary Image
Final Outcome
![Page 16: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/16.jpg)
Simulated Images
• No Method was best• Different method performed well for different images• Performance Evaluation on Real Images crucial
![Page 17: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/17.jpg)
• General Characteristics– Vehicles vs. pavement
• pavement type, vehicle color, atmospheric conditions
– Objects: Road signs, Lane markings– Road geometry– Traffic density
Real Image Test Cases
![Page 18: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/18.jpg)
Image: I 75 – 1
Main Characteristic•Pavement material transition
Thresholded PC Band
Clustered Thresholded Gradient Img
Clustered
![Page 19: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/19.jpg)
I 75 – 1
Probability Map Clustered
Probability Map
![Page 20: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/20.jpg)
Image: I 75 – 2
•Pavement material transition
Thresholded PC Band
Clustered Thresholded Gradient
Img
Clustered
![Page 21: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/21.jpg)
I 75 – 2
Probability Map
Clustered Probability
Map
![Page 22: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/22.jpg)
Image: I 270 – 1•Pavement material transition•Overpass•Lane markings•Curved road segment
Thresholded PC Band Clustered
Thresholded Gradient Img
Clustered
![Page 23: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/23.jpg)
I 270 – 1
Probability Map Clustered Probability Map
![Page 24: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/24.jpg)
Image: I 270 – 2
Thresholded PC Band
Clustered
Thresholded Gradient Img
Clustered
•Lane markings•Pavement material transition•Straight segment•Fairly dense traffic
![Page 25: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/25.jpg)
I 270 – 2
Probability Map
Clustered Probability Map
![Page 26: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/26.jpg)
Image: I 70 – 1
Thresholded PC Band
Clustered
Thresholded Gradient Img
Clustered
•Lane markings•Sign board•Fairly dense traffic•Straight road segment
![Page 27: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/27.jpg)
I 70 – 1
Probability Map
Clustered Probability Map
![Page 28: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/28.jpg)
Image: I 10 – 1
•Straight road segment•Median•Good vehicle vs. pavement contrast
PC Band Thresholded… ClusteredGradient Img Thresholded… Clustered
![Page 29: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/29.jpg)
I 10 – 1
Probability Map Clustered
![Page 30: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/30.jpg)
Image: I 270 – 3
•Multiple pavement material transitions•Median•High traffic density
![Page 31: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/31.jpg)
I 270 – 3
![Page 32: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/32.jpg)
Image: I 71 – 1
•Poor vehicle vs. pavement contrast•Illumination change•Overpass
Thresholded PC Band
Clustered
![Page 33: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/33.jpg)
I 71 – 1
Thresholded Gradient Img
ClusteredClustered Probability Map
![Page 34: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/34.jpg)
I 71 – 1
![Page 35: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/35.jpg)
Image: I 70 – 2
•Cloud cover•Overpass•Pavement material transition
![Page 36: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/36.jpg)
I 70 – 2
Thresholded PC Band
Clustered
![Page 37: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/37.jpg)
I 70 – 2
Thresholded Gradient Img
Clustered
![Page 38: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/38.jpg)
I 70 – 2
Probability Map Clustered Probability Map
![Page 39: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/39.jpg)
I 70 – 2
![Page 40: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/40.jpg)
Results SummarySummary: Errors of Omission and Commission
•BBT and gradient method give numbers close to the real values•Large errors of omission and commission for PCA and gradient based method•Low omission and commission errors for BBT method
![Page 41: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/41.jpg)
Summary
![Page 42: Vehicle Detection with Satellite Images Presented by Prem K. Goel NCRST-F, The Ohio State University Workshop on Satellite Based Traffic Measurement Berlin,](https://reader030.fdocuments.in/reader030/viewer/2022032606/56649e8e5503460f94b91ef3/html5/thumbnails/42.jpg)
Future Needs
• Methods Not Requiring Background
• Post-processing
– sieving and clustering– Effort– Process