Tailored Displays to Compensate for Visual Aberrations - SIGGRAPH Presentation

Vitor PamplonaManuel M. OliveiraDaniel AliagaRamesh Raskar

Tailored Displays to Compensatefor Visual Aberrations

TailoredDisplays.com

Emmetropic View

Farsighted View(need of reading glasses)

Tailored Dashboard(actual results)

Sean Dreilinger

Chris Streeter

Focal RangePerfect vision

Computer Generated Glasses

Myope’sFocal Range


Focusing Here

Subject’s Focal Point Does Not Change


Hyperope’s and Presbyope’sFocal Range

Focusing Here

Subject’s Focal Point Does Not Change

We can create a hologram for the visually impaired

because uncorrected individuals are already not focusing on the display

and there is no mismatch between convergence and accommodation

Tailoring ProcessFocusing Here

Myopic View: -3D

He can focus up to 33cm (12in)

Distance Display-Eye: 50cm

BlurredImage

Light-fieldDisplay

Tailoring ProcessHe can focus up to 33cm (12in)


Focusing HereMyopic View: -3D

Light-fieldDisplay

Tailoring ProcessHe can focus up to 33cm (12in)


Focusing Here

1 arc-minute Resolution

Pixel Size of 96um at 33cm

Myopic View: -3D

Pixel Size and Alignment

Pixel on the Virtual image

1 arcminute

Zoomed Version

Working Resolution: 1800 DPI

Channel Size4.7um!

$150 Vuzix HMD LCD

Astigmatism: angle-dependent refractive error

Light-fieldDisplay

Tailoring Process Subject’s prescription -2D -1D @ 90

He focus at 30cm to 50cm.Two Points in Focus

Where the Subject’s

Accommodate

30cm50cm

Wavefront Maps

0 degrees

90 degrees

Sphere: -2DCylinder: -1DAxis: 90°

Lens focal length in k

k

Zernike Polynomials

Light-fieldDisplay

f(k)

Inputs

LCD1

LCD1 LCD2

Tailoring Process

Eye

Single-Focus Multi-Depth Displays

Only one object

Display

Eye

S1 S2

R

k

t a

f(k)

Cataract Maps

Nuclear Cataract Cataract density in k

k

Sub-capsular Cataract

Avoiding CataractsDisplay

Eye

NormalizationDisplay

Eye

Dual Stack of LCDs

Projector

Camera – the “eye”

Vuzix Head Mounted Display

Lens Array

Vuzix Head Mounted Display

Input Image

As Seen on a Regular Display As Seen on a Tailored Display

3.25D Myopic Eyeusing a display at

37cm from the eye

Resolution of 0.87 arc minutes

No Cataract Tailoring Tailored for CataractsNo Cataracts

Input

3.5D Myopic Eye with Nuclear Cataracts

Display at 47cm from the eye

Resolution of 0.87 arc minutes

20cm / 7.8in

Presbyopic +3D View

Out-of-focus Blur Size

20cm / 7.8in

Presbyopic +3D View

Out-of-focus Blur Size8cmx8cm Size

20cm / 7.8in

50cm / 20in

Presbyopic +3D View


1x1cm Light-Field Display

20cm / 7.8in

Presbyopic +3D View


20cm / 7.8in

50cm / 20in

Presbyopic +3D View


20cm / 7.8in

Presbyopic +3D View


20cm / 7.8in

50cm / 20in

Presbyopic +3D View


User Evaluations: Strong Myopia

1D 2D 3D 4D 5D0D

Focal RangePerfect vision


1D 2D 3D 4D 5D0D

5D


1D 2D 3D 4D 5D0D


1D 2D 3D 4D 5D0D

5D


13 Volunteers, 16 votes each.

User Evaluations: Astigmatism

10 Volunteers, 16 votes each.

User Evaluations: Keratoconus

1 Volunteer, 80 votes.

AAAA ARegulardisplay

Tailoreddisplay

User Evaluations: Keratoconus

1 Volunteer, 80 votes.

Multi-Focus Multi-Depth Display

Input Image Input Depth

+0.5D from the Image Plane -0.5D from the Image Plane

61

Limitations • Eyes fixed relative to the display– Similar to glasses-free 3D Displays– Higher-order requires more fixation

• High-resolution LCD panels (PPI) – Giga-pixel displays for monitors

• Other ocular diseases may not be corrected for


• The First Multi-depth Multi-focus Display– Time-varying Optical Corrections– Resolution around 1 arc minute

• Correcting for a Wide Range of Conditions:– Myopia, Hyperopia and Presbyopia– Astigmatism and High-order aberrations– Cataracts

www.TailoredDisplays.com

Future Works• Retinal Diseases on the Tailoring Pipeline– Retinal Displacements (Image Warping)– Color Blindness (Re-coloring)

• Light-Field to Hardware Mapping– Temporal and Context-Based Optimizations for Brightness

• Stereo Multi-focus Multi-depth Displays

Vitor PamplonaManuel M. OliveiraDaniel AliagaRamesh Raskar


TailoredDisplays.com

Cell Phone-based Refractive Measurements

The Inverse of Shack-Hartmann

Vitor Pamplona, Manuel Oliveira, Ankit Mohan, Ramesh Raskar

Unique, low-costquantitative lens mapping

CATRA: Quantitative Cataract Maps

Vitor Pamplona, Erick Passos, Jan Zizka, Everett Lawson, Esteban Clua, Manuel Oliveira, Ramesh Raskar

Measurement Correction

Need

Super Vision?

Challenge

4 billion people estimated to need eyeglasses

worldwide

Source: Essilor, Infomarket 2009, CPB Research,

Emerging Asia

Africa & Middle East

Latin America

Europe North America

0.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

1.60

1.80

1.70

0.50

0.13 0.10 0.02

Billions of People with Uncorrected Refractive Error, by

Region

Challenge

90% of high-school kids are myopic inmajor Asian cities

Morgan et al. 2012. Science 2012.

Due to:

1. Heavy “near work” 2. Intensity of education.3. Games, computers and TV.4. Insufficient time spent

outdoors.

User Experience Design Challenges

Eye Glasses Contact Lenses

Multi-focals

Surgery Adaptive optics

Adaptive spectacles

Tailoring

Technology Coated Hard Lenses+Frame

Flexible/Hard Lenses

Hard Lenses with many

focal powers

LASIK and Cataract Surgery

Dynamic micro mirror

array on contacts

Liquid / Electronic / Mechanic

Lenses

Parallax Barrier

Cost in the US <$100 <$50 ~$200 ~$2,000 Expensive $30 Feature

Quality 1 arc-min 1 arc-min 1 arc-min 1 arc-min 1 arc-min 1 arc-min 1 arc-min

Astigmatism Yes Yes Yes Yes Yes No Yes

Cataracts No No No Yes Yes No Yes

Keratoconus No Yes No No No No Yes

Adaptive No No No No Yes Yes Yes

Carry on Yes No Yes No No Yes No

Need doctor Yes Yes Yes Yes ? No No

Maintenance Easy Medium Easy Nothing Hard Medium Easy

Invasive No Yes No Yes Yes No No

Needs expert, Annoying Experience, Limited


1D 2D 3D 4D 5D0D


1D 2D 3D 4D 5D0D

5D


1D 2D 3D 4D 5D0D

Tailored Displays to Compensate for Visual Aberrations - SIGGRAPH Presentation

Technology

Transcript of Tailored Displays to Compensate for Visual Aberrations - SIGGRAPH Presentation