Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley...

32
Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct 2015

description

Given images, reconstruct: –Scene geometry (structure) –Camera positions (motion) Unknown camera positions Structure and Motion Problem

Transcript of Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley...

Page 1: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Critical Configurations for Projective Reconstruction

Fredrik Kahl

Joint work with Richard Hartley

Chalmers University of TechnologyLund University

Oct 2015

Page 2: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

• Problem statement• Two-view critical configurations• Three views and more• Conclusions

Outline

Page 3: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

• Given images, reconstruct: – Scene geometry (structure)– Camera positions (motion)

Unknown cameraUnknown camerapositionspositions

Structure and Motion Problem

Page 4: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 5: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 6: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Investigated previously by:• Krames (1940)

• Hartley & Kahl (2007)

• Buchanan (1988)• Maybank (1993)• Maybank & Shashua (1998)

When is the solution unique?

• Bertolini, Besana, Turrini (2007,2009,2015)

• And others...

This work: Complete classification of all critical configurations in two and more views

Page 7: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 8: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 9: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Notation

Page 10: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 11: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 12: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 13: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 14: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

hyperboloid cone

Page 15: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 16: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 17: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 18: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 19: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 20: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 21: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 22: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 23: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 24: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 25: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.
Page 26: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Proof based on a generalization of Pascal’s Theorem

Page 27: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Pascal’s Theorem (1639)

For generalization to quadrics, see:

Richard Hartley, Fredrik Kahl,Critical Configurations for Projective Reconstruction from Multiple Views, International Journal of Computer Vision, 2007.

Page 28: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

N-view critical configurations

• Given N>3 cameras and a point set, then critical iff each subset of three cameras and point set critical

Page 29: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Open problem

• What are the critical configurations for the calibrated case?

Page 30: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Carlsson duality and critical configurations

• Exchange role of points and cameras via a Cremona transformation

• Dual configurations:– N cameras and M+4 points– M cameras and N+4 points• Example: ”2-view ambiguity and

arbitrary points on a hyperboloid” is dual to ”arbitrary cameras and 6 points on a hyperboloid”

Page 31: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Conclusions• Critical configurations for the structure and

motion problem• Main criticalities:

– (i) elliptic quartics (intersection of two quadratic surfaces)

– (ii) rational quartic curve on a non-degenerate quadratic surface

– (iii) twisted cubic ...• Projective geometry essential tool

Page 32: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct.

Thank you for your attention!