Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... ·...

42
Mathematical Morphology a non exhaustive overview Adrien Bousseau

Transcript of Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... ·...

Page 1: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

Mathematical Morphologya non exhaustive overview

Adrien Bousseau

Page 2: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

2Mathematical Morphology

Mathematical Morphology• Shape oriented operations, that “ simplify

image data, preserving their essential shape characteristics and eliminating irrelevancies” [Haralick87]

Page 3: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

3Mathematical Morphology

Overview• Basic morphological operators

• More complex operations

• Conclusion and References

Page 4: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

4Mathematical Morphology

Overview• Basic morphological operators

– Binary

– Grayscale

– Color

– Structuring element

• More complex operations

• Conclusion and References

Page 5: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

5Mathematical Morphology

Basic operators: binary• Dilation , erosion by a structuring element

Page 6: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

6Mathematical Morphology

Basic operators: binary• Opening ° : remove capes, isthmus and

islands smaller than the structuring element

Page 7: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

7Mathematical Morphology

Basic operators: binary• Closing ° : fill gulfs, channels and lakes

smaller than the structuring element

Page 8: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

8Mathematical Morphology

Basic operators: binary• Sequencial filter: open-close or close-open

Page 9: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

9Mathematical Morphology

Overview• Basic morphological operators

– Binary

– Grayscale

– Color

– Structuring element

• More complex operations

• Conclusion and References

Page 10: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

10Mathematical Morphology

Basic operator: grayscale• Dilation : max over the structuring element

Page 11: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

11Mathematical Morphology

Basic operator: grayscale• Erosion : min over the structuring element

Page 12: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

12Mathematical Morphology

Basic operator: grayscale• Opening ° : remove light features smaller

than the structuring element

Page 13: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

13Mathematical Morphology

Basic operator: grayscale• Closing ° : remove dark features smaller

than the structuring element

Page 14: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

14Mathematical Morphology

Basic operator: grayscale• Sequential filter (open-close or close-open):

remove both light and dark features

Page 15: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

15Mathematical Morphology

Overview• Basic morphological operators

– Binary

– Grayscale

– Color

– Structuring element

• More complex operations

• Conclusion and References

Page 16: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

16Mathematical Morphology

Color images• Process each channel separately: color ghosting

with basic operators

Page 17: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

17Mathematical Morphology

Color images• Process each channel separately: color ghosting

unnoticeable with sequential operators

opening

Page 18: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

18Mathematical Morphology

Color images• Several ordering strategy

Page 19: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

19Mathematical Morphology

Overview• Basic morphological operators

– Binary

– Grayscale

– Color

– Structuring element

• More complex operations

• Conclusion and References

Page 20: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

20Mathematical Morphology

Structuring element• Usually, flat element (binary)

• Grayscale element: fuzzy morphology

Page 21: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

21Mathematical Morphology

Structuring element• Shape has an impact!

Page 22: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

22Mathematical Morphology

Structuring element• Choose the structuring element according to

the image structure

Page 23: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

23Mathematical Morphology

Structuring element• Choose the structuring element according to

the image structure

Page 24: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

24Mathematical Morphology

Overview• Basic morphological operators

• More complex operations– Reconstruction operators

– Top hat, sharpening, distance, thinning, segmentation...

• Conclusion and References

Page 25: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

25Mathematical Morphology

Reconstruction operators• Remove features smaller than the structuring

element, without altering the shape

• Reconstruct connected components from the preserved features

Page 26: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

26Mathematical Morphology

Reconstruction operators: binary• Opening by reconstruction:

– Erosion: f'(0) = f

– Iterative reconstruction: f'(t+1) = min(f'(t),I)until stability

Page 27: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

27Mathematical Morphology

Reconstruction operators: binary• Closing by reconstruction:

– Dilation: f'(0) = f

– Iterative reconstruction: f'(t+1) = max(f'(t),I)until stability

Page 28: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

28Mathematical Morphology

Reconstruction operators: grayscale

• Opening by reconstruction: remove unconnected light features

Page 29: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

29Mathematical Morphology

Reconstruction operators: grayscale

• Closing by reconstruction: remove unconnected dark features

Page 30: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

30Mathematical Morphology

Reconstruction operators: grayscale

• Sequential filter by reconstruction: open-close

Page 31: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

31Mathematical Morphology

Overview• Basic morphological operators

• More complex operations– Reconstruction operators

– Top hat, sharpening, distance, thinning, segmentation...

• Conclusion and References

Page 32: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

32Mathematical Morphology

Top Hat• White top-hat: f-opening(f)

Extract light features

Page 33: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

33Mathematical Morphology

Top Hat• Black top-hat: closing(f)-f

Extract dark features

Page 34: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

34Mathematical Morphology

Edge sharpening• Toggle mapping

f   f   f   (f+f)/2 

Page 35: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

35Mathematical Morphology

Edge sharpening• Toggle mapping

Page 36: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

36Mathematical Morphology

Distance function• Distance from binary elements

Page 37: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

37Mathematical Morphology

Thinning• Binary (or grayscale ?) skeleton

Page 38: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

38Mathematical Morphology

Segmentation• Watershed:

– Image = heightfield

– Flood the image from its minima

– Lake junctions give the segmentation

Page 39: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

39Mathematical Morphology

Segmentation• Watershed: hierarchical results

Page 40: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

40Mathematical Morphology

Overview• Basic morphological operators

• More complex operations

• Conclusion and References

Page 41: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

41Mathematical Morphology

Conclusion• Powerful toolbox for many image analysis

tasks

• Not famous because not useful?

• Not used because not famous?

• Based on a whole mathematical theory

• But can be very practical (maybe too much?)

• French!

Page 42: Mathematical Morphology - Inriamaverick.inria.fr/Members/Adrien.Bousseau/morphology/... · 2007-05-21 · Mathematical Morphology 41 Conclusion • Powerful toolbox for many image

42Mathematical Morphology

References• Pierre Soille, 2003: Morphological Image

Analysis, Principles and Applications.(Practical approach)

• Jean Serra and Luc Vincent, 1992: An Overview of Morphological Filtering.(Mathematical approach)