Contour Detection and Hierarchical Image Segmentation
description
Transcript of Contour Detection and Hierarchical Image Segmentation
![Page 1: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/1.jpg)
1
P. Arbelaez, M. Maire, C. Fowlkes, J. Malik. Contour Detection and Hierarchical image Segmentation. IEEE Trans. on PAMI , 2011.
CONTOUR DETECTION AND HIERARCHICAL IMAGE SEGMENTATION
Student: Hsin-Min ChengAdvisor: Sheng-Jyh Wang
![Page 2: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/2.jpg)
2
Outline
Introduction Contour Detection Hierarchical Segmentation Results Conclusion
![Page 3: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/3.jpg)
3
Introduction
Original Image Contour
Contour
![Page 4: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/4.jpg)
4
Introduction
Original Image Segmentation
Segmentation
![Page 5: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/5.jpg)
5
Introduction From Contour to Segmentation
Original Image SegmentationContour
![Page 6: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/6.jpg)
6
Introduction Goal
Contour Detection Hierarchical Segmentation from Contours
Original Image SegmentationContour
![Page 7: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/7.jpg)
7
Outline
Introduction Contour Detection Hierarchical Segmentation Results Conclusion
![Page 8: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/8.jpg)
8
Contour Detection
1. Learn local boundary cues 2. Global framework to capture
closure, continuity3. Local Cues and global cues
combination
![Page 9: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/9.jpg)
9
Learn local boundary cues
Image Local Boundary Cues
Model
BrightnessColorTexture
Cue Combination
Contour Detection
![Page 10: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/10.jpg)
10
Learn local boundary cues Brightness L*a*b* colorspace
Color L*a*b* colorspace
Texture Convolve with 17 filters
Filters for creating textons
Contour Detection
![Page 11: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/11.jpg)
11
Learn local boundary cues Oriented gradient of histograms Example
Gradient magnitude G at location(x, y)
Three scales of r
11
Contour Detection
ure ]2 , ,2
[
![Page 12: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/12.jpg)
1212
Learn local boundary cues Local Cues Combination
12
Contour Detection
ure ]2 , ,2
[ r
![Page 13: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/13.jpg)
13
Global framework to capture closure, continuityContour Detection
V: image pixels
E: connections between pairs of nearby pixels
=>Build a weighted graph G=(V,E) from image
![Page 14: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/14.jpg)
14
Global framework to capture closure, continuityContour Detection
![Page 15: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/15.jpg)
15
Local Cues and global cues combinationContour Detection
Local Cues Global cues
![Page 16: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/16.jpg)
16
Outline
Introduction Contour Detection Hierarchical Segmentation Results Conclusion
![Page 17: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/17.jpg)
17
Hierarchical Segmentation Multiple Segmentations
Fixed resolution
Hierarchy of Segmentations Flexible resolution adjustment
![Page 18: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/18.jpg)
18
Hierarchical Segmentation1. From contours to segmentation2. Hierarchical segmentation by
iterative merging
![Page 19: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/19.jpg)
19
Hierarchical Segmentation From contours to segmentation
Watershed Transform Concept
![Page 20: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/20.jpg)
20
Hierarchical Segmentation From contours to segmentation
Watershed Transform Example
![Page 21: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/21.jpg)
21
Hierarchical Segmentation From contours to segmentation
Watershed Transform
Boundary strength ArtifactsWeight each arc
![Page 22: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/22.jpg)
Hierarchical Segmentation From contours to segmentation
Oriented Watershed Transform
22
WTOWT
![Page 23: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/23.jpg)
23
Hierarchical Segmentation Hierarchical segmentation by iterative
merging Hierarchical segmentation
Example
![Page 24: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/24.jpg)
24
Brief SummaryOriginal Image
- Local cues - Global cues
Oriented Gradientof histograms
Contour
Oriented Watershed Transform
Iterative Merging
Hierarchical Segmentation
![Page 25: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/25.jpg)
25
Outline
Introduction Contour Detection Hierarchical Segmentation Results Conclusion
![Page 26: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/26.jpg)
26
Result
![Page 27: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/27.jpg)
27
Result
![Page 28: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/28.jpg)
28
Result
Evaluation of segmentation algorithmsEvaluation of contour detector
BSDS300 Dataset
![Page 29: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/29.jpg)
29
Outline
Introduction Contour Detection Hierarchical Segmentation Results Conclusion
![Page 30: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/30.jpg)
30
Conclusion A high performance contour detector, combining
local and global image information
A method to transform any contour detector signal into a hierarchy of regions while preserving contour quality
![Page 31: Contour Detection and Hierarchical Image Segmentation](https://reader036.fdocuments.in/reader036/viewer/2022081505/5681608f550346895dcfb24c/html5/thumbnails/31.jpg)
31
Reference P. Arbelaez, M. Maire, C. Fowlkes and J. Malik. Contour Detection
and Hierarchical Image Segmentation. IEEE TPAMI, Vol. 33, No. 5, pp. 898-916, May 2011
P. Arbelaez, M. Maire, C. Fowlkes and J. Malik. From Contours to Regions: An Empirical Evaluation. In CVPR 2009.
P. Arbelaez and L. Cohen. Constrained Image Segmentation from Hierarchical Boundaries. In CVPR 2008.