3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How...
-
Upload
mervyn-holland -
Category
Documents
-
view
219 -
download
0
Transcript of 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How...
![Page 1: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/1.jpg)
3D Space Perception(aka Depth Perception)
![Page 2: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/2.jpg)
3D Space Perception
• The flat retinal image problem:
How do we reconstruct 3D-space from 2D image?
What information is available to supportthis process?
• Interaction between Perceived Size and Perceived Distance (both depend upon “scaling”)
![Page 3: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/3.jpg)
Size Constancy
Perceived size is not slavishly linked to retinal size; otherwise your car would appear to be smaller when observed at increasing distances.
Instead, perceived size tends to remain invariant across observation distance…a phenomenon known as size constancy.
Perceived size depends upon the psychological scaling of retinal size relative to perceived distance. Hence, size, distance and 3D visual perception are all based upon a more complex process known as spatial scaling.
Corollary: Perceived Speed = retinal velocity x scaled distance
![Page 4: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/4.jpg)
Failures of Size Constancy
The Moon Illusion
![Page 5: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/5.jpg)
Failures of Size Constancy
The Buechet ChairClick here for more
![Page 6: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/6.jpg)
The Ames Room(Iowa State University at Ames, IA)
Failures of Size Constancy
![Page 7: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/7.jpg)
3D-Depth Information “Cues”
![Page 8: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/8.jpg)
Oculomotor Information
• State of Accommodation• State of Vergence
![Page 9: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/9.jpg)
Accommodation
In theory, the efferent signal driving the ciliary muscles (and/or afferent feedback from stretch sensors in the ciliary muscles) could be used by higher-order visual processes to help scale 3D space and/or visual distance.
There is little evidence to support this hypothetical role of accommodation.
![Page 10: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/10.jpg)
Vergence Eye Movements
Support for the role of efferent/afferent 3D information from vergence eye movements comes from:
“Tower Speed Illusion”and
Botox Treatment of Rectus Muscles in
Strabismus Surgery
![Page 11: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/11.jpg)
Static MonocularSources of 3D Information
• Occlusion• Familiar Size (Relative Size)• Texture Gradients• Linear Perspective• Aerial Perspective (Atmospheric extinction)• Shadow Casting
![Page 12: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/12.jpg)
Occlusion
Near objects block visual access to far objects
![Page 13: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/13.jpg)
Linear Perspective
Parallel lines on thevisual plane convergetoward the “vanishingpoint” with increasing observation distance
This law of projectivegeometry provides a strong cue about distanceand 3D space.
![Page 14: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/14.jpg)
Linear Perspective
![Page 15: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/15.jpg)
Linear Perspective in the Service of Art
![Page 16: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/16.jpg)
Familiar Size/Relative Size
Objects of the same physical sizeproject different size retinal images depending upon the observation distance.
This knowledge and prior experience contribute to 3D space perception.
What is the height of thissculpture in feet?
![Page 17: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/17.jpg)
Familiar Size Cue
Easter Island Sculpturewithout Familiar Size Cue
Easter Island Sculpturewith Familiar Size Cue
Novel objects can be psychologically scaled given visual referencesof known size. For example…
![Page 18: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/18.jpg)
Texture Gradients
An extended surfacewith uniform spatialtexture will project a retinal image with a non-uniform texture gradient that increases in spatial frequency as observation distance increases.
![Page 19: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/19.jpg)
Aerial Perspective
Particulate matter in the atmosphere scatters light; reducing contrast and intensity of the retinal image.
The light from distant objects must pass through more atmosphere than the light from near objects.
![Page 20: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/20.jpg)
Shadow Casting
Just as occlusion of objects serves as a powerful cue for depth…occlusion of the illuminant (sun) forms shadows which provide a powerful source of information for extracting 3D representations from a 2D retinal image.
![Page 21: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/21.jpg)
Identify the Monocular Depth Cues
A Rainy Day in ParisGustav Caillebotte (1848-1894)
![Page 22: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/22.jpg)
Identify the Monocular Depth Cues
A Rainy Day in ParisGustav Caillebotte (1848-1894)
Linear Perspective
Occlusion
Texture Gradient
Aerial Perspective
Shadow Casting
Familiar Size
![Page 23: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/23.jpg)
Dynamic MonocularSources of 3D Information
• Motion Parallax• Relative Angular Velocity• Radial Expansion/Looming• Moving Shadows
![Page 24: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/24.jpg)
Motion ParallaxMotion parallax occurs when an observer fixates a point at intermediate distance and then rotates their head.
Objects in the distance appear to move WITH head motion; while objects closer than the fixation plane appear to move AGAINST the rotation of the head.
Motion Parallax and DynamicShadow Casting Demo
![Page 25: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/25.jpg)
Optic Flow: Radial Expansion
Optic Flow and Driving Demo
![Page 26: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/26.jpg)
Delta Angular Velocity/Angular Size
Lecture Note:Need for improved Slow Moving Vehicle sign/
![Page 27: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/27.jpg)
Binocular Depth Perception
![Page 28: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/28.jpg)
Advantages of Binocularity
• Redundancy (survival value)• Stereopsis (Predators)
Large Field-of-View (Prey)• Binocular summation improves sensitivity
by √2 (signal:noise ratio sampling theory)Binocular acuity better than monocular;Same for CSF and many other functions
![Page 29: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/29.jpg)
Binocular Vision (cont.)
• Binocular rivalry(Role of the “dominant” eye)
• Autokinesis phenomenon
![Page 30: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/30.jpg)
Stereopsis
• Ability to use binocular retinal disparity information to extract relative depth information from the retinal image pairs
• Retinal “mismatch” can be used to reconstruct much of the missing 3rd dimension from the flat retinal images
![Page 31: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/31.jpg)
Retinal Disparity
Understanding begins with a consideration of the geometry of the horopter
![Page 32: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/32.jpg)
Horopter(Corresponding Retinal Images)
The HOROPTER is an imaginary surface whose points are all at thesame distance as the fixation point.
Points on the horopter project tocorresponding locations on the temporal and nasal retinas,respectively.
These corresponding locationsexhibit zero retinal disparity
i.e., D = dtemporal – dnasal = 0
![Page 33: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/33.jpg)
“Crossed” and Uncrossed” Retinal Disparity
The corresponding locations for the“closer” green stimulus exhibitspositive retinal disparity
D = dtemporal – dnasal > 0(or “crossed” disparity)
The corresponding locations for the“farther” red stimulus exhibitsnegative retinal disparity
D = dtemporal – dnasal < 0(or “uncrossed” disparity)
![Page 34: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/34.jpg)
DepthRecovery
byBinocularCortical
Cells
![Page 35: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/35.jpg)
Panum’s Fusion Area
![Page 36: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/36.jpg)
Nativists v. Empiricists “Debate”
• Nativist positionThe CNS is capable of processing many environmental invariants at birth – giving rise to direct perception (e.g., James Gibson)
• Empiricist positionSensory information is too impoverished to explain perceptual experience without recourse to knowledge about the world; it is based upon “unconscious inference” (e.g., Bishop Berkeley)
![Page 37: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/37.jpg)
Support for Nativism
• Eleanor Gibson’s Visual Cliff Experiment(and HRD replication studies)
• Bela Julesz’s Random Dot Stereogram paradigm
![Page 38: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/38.jpg)
Random DotStereograms
Bela Julesz
Can retinal disparity yield perception of depth independent of knowledge about the nature of the world?
Nativist vs. Empiricist Debate
![Page 39: 3D Space Perception (aka Depth Perception). 3D Space Perception The flat retinal image problem: How do we reconstruct 3D-space from 2D image? What information.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d155503460f949ea00e/html5/thumbnails/39.jpg)
Red-Blue Anaglyph Technique(black background)
Anaglyph glasses transmit RED and MAGENTA dots to the left eye; and, the BLUE and MAGENTA dots to the right eye.
Demo stimulus from USD’s PSYC 301 Lab