Seeing a 3-d World : Depth Perception

download Seeing a 3-d World : Depth Perception

of 66

Transcript of Seeing a 3-d World : Depth Perception

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    1/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    2/66

    The retinal images from which depthinformation is extracted are two-dimensional:they are inherently depthless

    Depth perception occurs effortlessly andwithout thought, despite being derived from atwo-dimensional image on the retina

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    3/66

    Major sources of depth information

    DEPTHINFORMATION

    OCULOMOTOR

    Perspective

    Static Cues

    Interposition

    Motion Parallax

    BINOCULAR MONOCULAR

    VISUAL

    Size

    Convergence

    Accommodation

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    4/66

    Oculomotor cues

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    5/66

    Oculomotor Cues to Depth

    To be seen clearly, closeobjects require moreaccommodation and

    convergence than doobjects farther away fromyou

    By monitoring the degree

    of muscular contraction, wecould compute either of 2values: your angle ofconvergence or the amount

    of accommodation from thelenses of our e es

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    6/66

    Can people judge distance under conditionswhere accommodation and convergenceprovide the only cues to depth?

    (1)Limited effective range for accommodation

    objects in front of you(2)Limited effective range for convergence 20

    feet and beyond

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    7/66

    Binocular cues

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    8/66

    Binocular visual fields

    To make use of binocular depth cues, anorganism must have a binocular visual field -- aregion of overlapping visibility for the two eyes.

    Different animals have different extents of

    binocular visual fields. In general, predatorshave both eyes on the front of their heads, andconsequently have large binocular visual fields.In contrast, prey typically have one eye on eitherside of their heads, and consequently havesmall, if any, binocular visual fields.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    9/66

    Binocular Visual Depth Information:Stereopsis

    Stereopsis : perception of relative depth frombinocular vision

    Allows us to judge relative depth with greataccuracy and it enables is to see objects that

    are invisible to either eye alone

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    10/66

    Retinal disparity as the stimulus of stereopsisThe magnitude of the disparity depends on

    the distance between objects

    if one object is closer to the observer than

    the other, large disparity if one object is only slightly closer to the

    observer than the other, small disparity

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    11/66

    Retinal disparity

    Although humans have large binocular visual fields,each eye is getting a slightly different view of the

    world because the two eyes are in slightly different

    positions.

    Retinal disparity is the difference between the lateralposition of object in the left and right eyes

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    12/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    13/66

    Retinal disparity ariseswhenever objects arelocated in front of or behindthe object you are looking at

    If an object lies farther fromyou than the object you arefixating on, the disparitybetween the two is said to

    be uncrossed If an object is located closer

    to you than the one you arelooking at, the disparity issaid to be crossed

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    14/66

    Horopter: imaginary plane where each object on the

    plane casts images on corresponding parts of both eyes.

    Includes the point of fixation. Objects same distance from observer as fixation yield zero

    disparity

    Objects on the horopter cast images on corresponding points ofboth eyes

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    15/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    16/66

    In this picture, the lifeguard is fixating on Ralph. Thecurved, dashed line represents the horopter: all points

    on this line are the same distance from the lifeguardas the fixation point. So, Susan and Harry (and Ralph)fall on the horopter; Carol and Charlie do not.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    17/66

    In the 1830s, Wheatstone developed a device with whichto view stereograms: the stereoscope. This devicepresented one two-dimsensional view of a scene to oneeye, and a slightly different two-dimensional view to the

    other eye. When the brain received these slightly different views

    from the two eyes, it integrated them into one three-dimensional scene. In other words, the disparity betweenthe two scenes enabled the observer to see depth.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    18/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    19/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    20/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    21/66

    Random dot stereograms

    In the 1960s (~130 years after the invention ofthe stereoscope), Julesz developed random dot

    stereograms.

    In a random dot stereogram, each eye sees only

    a collection of spatially random dots. But whenthe information from the two eyes is combined,

    the observer can see depth, and the depth can

    define a form. In this case, then, depth

    perception can precede form perception.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    22/66

    In random dot stereograms, neither eye sees anyclear form on its own. The percept of form follows thepercept of depth. If no clear form is perceived in eithermonocular view, how does the visual system knowwhich features in one eye's view match up with which

    feature's in the other eye's view?

    This question is known as the correspondenceproblem for stereovision.

    spatial frequency information plays a role in solving thecorrespondence problem we need overlapping spatial frequency information in the two

    eyes to see stereo

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    23/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    24/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    25/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    26/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    27/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    28/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    29/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    30/66

    Do we all have stereopsis? NO!! There are great individual

    difference in stereovision abilities. (5-10% of humans) is stereoblind Stereopsis requires properly working

    binocular cells

    Properly working binocular cells requirenormal visual experience Kittens raised with only one eye open at

    a time do not develop normal binocularcells, even though they appear to benormal in every other respect

    Humans who had abnormal early visualexperiences (e.g., strabismus), often do

    not have stereovision. There is a criticalperiod for the development of binocularcells (and consequently stereovision). Ifthe problem causing abnormal earlyvisual experience is not caught earlyenough, it can lead to permanentdamage.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    31/66

    Binocular vision can producepartial occlusion,a special form of retinal disparity

    when one object partially occludes anothermore distant object, one eye will see portionsof the more distant object that are invisible to

    the other eye

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    32/66

    Monocular cuesMonocular cues

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    33/66

    Occlusion: Closer objects partly block theview of more distant objects. Occlusion leads to a percept of depth (you see the

    occluding object as closer than the occluded

    object). Occlusion also enables us to complete and

    recognize objects.

    Occlusion is closely related to other perceptual

    phenomena such as transparency and illusory

    contours.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    34/66

    By 7 months of age, human infants can judgerelative distance solely on the basis ofocclusion

    Occlusion is such a strong depth cue that it

    can override retinal disparity when the twocues conflict

    The effectiveness of occlusion is amplifiedwhen the surface of the occluding object

    contains high spatial frequency information

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    35/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    36/66

    Objects occluded by anearer figure are seenas complete, eventhough portions of theirsurfaces are obscuredby the nearer object

    (amodal completion)

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    37/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    38/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    39/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    40/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    41/66

    Size: As the distance between you and an

    object varies, the sixe of the image of thatobject on your retina changes

    Smaller objects often appear to be moredistant than identical larger objects

    Familiar size is an effective cue to distance inthe absence of other information. BUT thecue of retinal size critically depends onknowing the correct size of the object

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    42/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    43/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    44/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    45/66

    Perception of size and depth perception

    An object can look the same size at differentdistances But: retinal image size changes with

    distance Increase distance : decrease retinal image size

    Decrease distance : increase retinal image size The fact that an object can look the same size

    regardless of changing retinal image size is

    referred to as size constancy

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    46/66

    These three disks look to be the same size,

    but at different depths. In fact, they varygreatly in terms of their retinal image sizes.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    47/66

    The fact that we have size constancy meansthat perceived size depends on more than justretinal image size.

    We seem to take perceived distance into

    account as well. This link between perceived size and

    perceived distance is known as size-distancescaling.

    We can formalize the notion of size-distancescaling in terms ofEmmert's law:

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    48/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    49/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    50/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    51/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    52/66

    Linear perspective: Lines that are parallel in the

    real world appear to converge in a drawing. The greater the distance, the greater the

    convergence. At infinity, lines meet at the vanishing point.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    53/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    54/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    55/66

    Texture gradients: Texture is more dense in adistant object than in an identical closer object. If there is no variation in texture density, no depth will

    be perceived.

    An abrupt change in texture implies a depthdiscontinuity (a sharp bend).

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    56/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    57/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    58/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    59/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    60/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    61/66

    Shading: Three-dimensional objects cast

    shadows, so 3D objects tend to haveluminance gradients. In perceiving depth from shading, we make certain

    default assumptions about lighting

    There is only one light source. Light comes from above. "Above" is defined retinally, not environmentally (i.e., the

    light seems to come from the same direction as the top ofyour head, even when you turn your head on its side).

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    62/66

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    63/66

    Because we assume that there is only one light source, and thatthat light source is from above, if an object is brighter on the topthan on the bottom, we'll perceive that object as convex (like the"eggs" that form an X in this picture).

    In contrast, if the object is brighter on the bottom than on the top,we'll perceive that object as concave (like the "holes" in this

    picture).

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    64/66

    MOVING

    Motion Parallax Objects at different distances from fixation move at

    different rates and directions on your retina. Motion parallax can be thought of a disparity across

    time in contrast to the disparity across eyes seen instereovision.

    Net result is the same: by integrating information aboutslightly different views across time, you see depth.

    Note that disparity from motion parallax is equivalent to

    disparity from stereopsis when the head/eye is movedthe distance between the two eyes.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    65/66

    Note how the retinal positions of the objects change as the eye moves

    from left to right. These differences in position give disparity across time:

    motion parallax.

  • 8/14/2019 Seeing a 3-d World : Depth Perception

    66/66

    End.