Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · •...

32
Lecture: Shape Analysis Introduction Guido Gerig CS 7960, Spring 2010

Transcript of Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · •...

Page 1: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Lecture:Shape Analysis

IntroductionGuido Gerig

CS 7960, Spring 2010

Page 2: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

References

[Dryden&Mardia] Statistical Shape Analysis, Wiley, Chichester, Dryden, I.L. and Mardia, K.V. (1998). DG Kendall (1984,Bull.Lond.Math.Soc)

Bookstein (1986,Statistical Science)

WS Kendall (1988,Adv.Appl.Probab.)

Christopher G. Small, The Statistical Theory of Shape, SpringerD’Arcy Thompson, 1917, On Growth and Form

Page 3: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape

The word “shape” is very commonly used in everyday language, usually referring to the appearance of an object.

Page 4: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape Properties: School Performance Test

Presenter
Presentation Notes
http://curriculum.qcda.gov.uk/key-stages-1-and-2/assessment/nc-in-action/items/mathematics/4/664.aspx
Page 5: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

What is Shape?

Page 6: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Example Biology

Page 7: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Example Astronomy

Page 8: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Example Geology

Page 9: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Example Biology

Page 10: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Example Biology

This picture clearly illustrates the typical shell shape differences between male (left) and female (right) eastern box turtles.

Page 11: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Industrial Example: Particle Analysis, ParticleSize Testing, Shape Classification

In machine condition monitoring, the ability to determine the size and shape of contaminant particles is becoming a necessary, if not critical capability. Particles in an used oil sample may be due to the normal wear process, but an increase of particles, and their size and shape will assist the oil analysis laboratory in determining the source and severity of a potential malfunction.

http://www.spectroinc.com/products-lasernet-fines.htm

Page 12: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape Classes

http://sites.google.com/site/xiangbai/try-large.jpghttp://sites.google.com/site/xiangbai/animaldataset

Page 13: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Computer Vision: MPEG-7

http://visionlab.uta.edu/shape_data.htmhttp://www.cis.temple.edu/~latecki/TestData/mpeg7shapeB.tar.gz

Vehicle shape classes: (a) Sedan, (b) Pickup, (c) Minivan, (d) SUV.

Airplane shape classes: (a) Mirage, (b) Eurofighter, (c) F-14 wings closed, (d) F-14 wings opened, (e) Harrier, (f) F-22, (g) F-15.

Presenter
Presentation Notes
http://images.google.com/imgres?imgurl=http://visionlab.uta.edu/shape_data/shape_3.gif&imgrefurl=http://visionlab.uta.edu/shape_data.htm&usg=__NHGsBcmXI_8PltckTq7pbZhqL4Q=&h=224&w=692&sz=9&hl=en&start=577&itbs=1&tbnid=6W2kRGEcL9kC7M:&tbnh=45&tbnw=139&prev=/images%3Fq%3Dshape%2Bclassification%26gbv%3D2%26ndsp%3D20%26hl%3Den%26sa%3DN%26start%3D560
Page 14: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Biometrics

Page 15: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Concept of Shape

Page 16: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Concept of Shape?

Page 17: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape: Definition

Page 18: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape Definition

Dryden/Mardia, (Kendall 1977):

Shape is all the geometrical information that remains when location, scale and rotationaleffects are filtered out from an object.

Page 19: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape Transformation

Dog to Cat

Symmetry Maps and TransformsFor Perceptual Grouping and Object Recognition, Benjamin B. Kimia, Brown

Presenter
Presentation Notes
http://images.google.com/imgres?imgurl=http://www.lems.brown.edu/vision/Presentations/Kimia/IMA/index-results.gif&imgrefurl=http://www.lems.brown.edu/vision/Presentations/Kimia/IMA/talk.html&usg=__De-SIwkxIWJ6F1qcNtfno_sP8pQ=&h=570&w=442&sz=11&hl=en&start=18&itbs=1&tbnid=KwklXYPaFjuatM:&tbnh=134&tbnw=104&prev=/images%3Fq%3Dshape%2Bclassification%26gbv%3D2%26hl%3Den
Page 20: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

The Problem of Size and ShapeDryden/Mardia(Kendall 1977): (Sometimes we are also interested in retaining scale information as well as shape):

Size-and-shape is all the geometrical information that remains when location and rotational effects are filtered out from an object.

Presenter
Presentation Notes
http://images.google.com/imgres?imgurl=http://www.datascope.be/MultiVarAnalPage/Fig-MDA-SizeShape.jpg&imgrefurl=http://www.datascope.be/MultiVarAnalPage/MDA-SizeShape.html&usg=__0x6n_imrfTHovwm2JMZChgv9_yc=&h=1424&w=1120&sz=84&hl=en&start=49&itbs=1&tbnid=hZq4uIXoza50ZM:&tbnh=150&tbnw=118&prev=/images%3Fq%3Dshape%2Bclassification%26gbv%3D2%26ndsp%3D20%26hl%3Den%26sa%3DN%26start%3D40
Page 21: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Landmarks

Google: Advanced Photoshop Pictures Contest

Page 22: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Landmarks (Dryden & Mardia)• A landmark is a point of correspondence

on each object that matches between and within populations.

• An anatomical landmark is a point assigned by an expert that corresponds between objects of study in a way meaningful in the context of the disciplinary context.

• Mathematical landmarks are points located on an object according some mathematical or geometrical property of the figure.

[Dryden & Mardia]

Page 23: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Landmarks

Page 24: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Landmarks

Three landmarks along a line for simple shape comparison

Ch. G. Small, The Statistical Theory of Shape

Page 25: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape and Registration

Homology:

Corresponding (homologous) features in all skull images.

Ch. G. Small, The Statistical Theory of Shape

Page 26: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape and Registration

Page 27: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape and Registration

Page 28: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Shape and Registration

Page 29: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Size of Configuration of Landmarks?

Page 30: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Alternative: Baseline SizeA Shape Coordinate System

==============================================

• Widely used in shape analysis for planar data.

• Most straightforward method for a newcomer to shape analysis.

• Experienced shape analysts often use Bookstein coordinates in the first stages of an analysis.

Page 31: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

Bookstein Coordinates

Page 32: Lecture: Shape Analysis Introductiongerig/CS7960-S2010/handouts/CS7960-AdvImProc-Shape... · • Widely used in shape analysis for planar data. • Most straightforward method for

More General:Equivalence Relationships

Two objects are equivalent (x1 ~ x2) if they can be transformed into each other by the following transformation:

define equivalence relationships: Properties:• Reflexivity: • Symmetry• Transitivity

txRx += 21 *)(* ϕα

mm ≈mnnm ≈→≈

pmpnnm ≈→≈∧≈

tR ,,α