Novel Depth Cues from Uncalibrated Near-field Lighting

45
Novel Depth Cues from Uncalibrated Near-field Lighting Sanjeev J. Koppal and Srinivasa Narasimhan Carnegie Mellon University Sponsors: ONR and NSF

description

Novel Depth Cues from Uncalibrated Near-field Lighting. Sanjeev J. Koppal and Srinivasa Narasimhan. Carnegie Mellon University Sponsors: ONR and NSF. Distant Lighting. Sun. Parallel Rays. Scene. Near-field Lighting. Indoor. Night. Underwater. Underground. - PowerPoint PPT Presentation

Transcript of Novel Depth Cues from Uncalibrated Near-field Lighting

Page 1: Novel Depth Cues from Uncalibrated Near-field Lighting

Novel Depth Cues from Uncalibrated Near-field Lighting

Sanjeev J. Koppal and Srinivasa Narasimhan

Carnegie Mellon University

Sponsors: ONR and NSF

Page 2: Novel Depth Cues from Uncalibrated Near-field Lighting

Distant Lighting

Sun

Scene

Parallel Rays

Page 3: Novel Depth Cues from Uncalibrated Near-field Lighting

Near-field Lighting

Indoor Night

Underground Underwater

Page 4: Novel Depth Cues from Uncalibrated Near-field Lighting

Scene

Calibrated Near Point Light Source

Inverse-square fall-off can give depth information

(Clark 92, Iwahori et al 94, Kao and Fuh 95, Magda et al 01, Zickler et al 02, Prados and Faugeras 05)

1

R 2

Page 5: Novel Depth Cues from Uncalibrated Near-field Lighting

Our Key Idea

Scene

Move an uncalibrated point light source in a line or a plane

‘baseline’

Page 6: Novel Depth Cues from Uncalibrated Near-field Lighting

Appearance Model

BRDF Illumination and Viewing angles Foreshortening

Distance to Source

Page 7: Novel Depth Cues from Uncalibrated Near-field Lighting

Experimental Setup

LED

Scene

Camera

Page 8: Novel Depth Cues from Uncalibrated Near-field Lighting

Plane-Scene Intersectionsfor Lambertian Scenes

Page 9: Novel Depth Cues from Uncalibrated Near-field Lighting

Light source moves in a line

t = i

Scene

Camera

t = 0

t = n

Page 10: Novel Depth Cues from Uncalibrated Near-field Lighting

Maxima in Intensity

Scene

Camera

Plane perpendicular to light source path.

t = i

t = 0

t = n

Page 11: Novel Depth Cues from Uncalibrated Near-field Lighting

Lambertian Scenes

Lambertian Model:

Solve for maxima location:

Expression for maxima:

Albedo

Quadratic

Shortest distance to light source path

If D is small, maxima happens at t = i

Page 12: Novel Depth Cues from Uncalibrated Near-field Lighting

Moving the Light Source in a Line

Page 13: Novel Depth Cues from Uncalibrated Near-field Lighting

Moving the Light Source in a Line

Page 14: Novel Depth Cues from Uncalibrated Near-field Lighting

Input Images

Page 15: Novel Depth Cues from Uncalibrated Near-field Lighting

Plane-Scene Intersections

Page 16: Novel Depth Cues from Uncalibrated Near-field Lighting

Similar to Structured Light

Page 17: Novel Depth Cues from Uncalibrated Near-field Lighting

Rough Earthen Pot

Page 18: Novel Depth Cues from Uncalibrated Near-field Lighting

Painted House

Page 19: Novel Depth Cues from Uncalibrated Near-field Lighting

Metal Office Desk

Page 20: Novel Depth Cues from Uncalibrated Near-field Lighting

Wax Candle

Page 21: Novel Depth Cues from Uncalibrated Near-field Lighting

Depth Orderingfor Homogeneous Scenes

Page 22: Novel Depth Cues from Uncalibrated Near-field Lighting

Light source moves in a plane

Scene

Camera

Page 23: Novel Depth Cues from Uncalibrated Near-field Lighting

Integrating the Profile

Integral of Profile:

P

Q

Overlapped Incident Angles

P

Q

S < S if:

Works for convex Lambertian scenes

p q

Page 24: Novel Depth Cues from Uncalibrated Near-field Lighting

Moving the Light Source in a Plane

Page 25: Novel Depth Cues from Uncalibrated Near-field Lighting

Moving the Light Source in a Plane

Page 26: Novel Depth Cues from Uncalibrated Near-field Lighting

Input Images

Page 27: Novel Depth Cues from Uncalibrated Near-field Lighting

Depth Ordering

Page 28: Novel Depth Cues from Uncalibrated Near-field Lighting

Plotting ordering as a pseudo-depth

Page 29: Novel Depth Cues from Uncalibrated Near-field Lighting

Plastic Beach Ball

Page 30: Novel Depth Cues from Uncalibrated Near-field Lighting

Plastic Beach Ball

Page 31: Novel Depth Cues from Uncalibrated Near-field Lighting

Polyresin Statue

Page 32: Novel Depth Cues from Uncalibrated Near-field Lighting

Polyresin Statue

Page 33: Novel Depth Cues from Uncalibrated Near-field Lighting

Depth Orderings from Different ‘Views’

Page 34: Novel Depth Cues from Uncalibrated Near-field Lighting

Depth Orderings from Left Plane

Page 35: Novel Depth Cues from Uncalibrated Near-field Lighting

Depth Orderings from Image Plane

Page 36: Novel Depth Cues from Uncalibrated Near-field Lighting

Depth Orderings from Right Plane

Page 37: Novel Depth Cues from Uncalibrated Near-field Lighting

Symmetry Pairsfor Homogeneous Scenes

Page 38: Novel Depth Cues from Uncalibrated Near-field Lighting

Matching Profiles

Scene

Camera

Page 39: Novel Depth Cues from Uncalibrated Near-field Lighting

Matching Profiles

Page 40: Novel Depth Cues from Uncalibrated Near-field Lighting

Light source moves in reflection plane

Page 41: Novel Depth Cues from Uncalibrated Near-field Lighting

Light source moves in reflection plane

Page 42: Novel Depth Cues from Uncalibrated Near-field Lighting

Input Images

Page 43: Novel Depth Cues from Uncalibrated Near-field Lighting

Symmetry Pairs

Page 44: Novel Depth Cues from Uncalibrated Near-field Lighting

Metal Office Desk

Page 45: Novel Depth Cues from Uncalibrated Near-field Lighting

Conclusions• Line or plane paths for a near

light source are a ‘baseline’.

• Depth cues can be obtained

from such uncalibrated light paths.

• The cues are from the light source

‘viewpoint’ and not from the camera.