WLSACONVERGENCE SUMMIT

SMARTPHONE BASED RETINAL IMAGING

ADAM SAMANIEGO, COMPUTER VISION AND COMPUTATIONAL IMAGING LAB

Adam Samaniego,

Computer Vision and Computational Imaging Lab

Smartphone based retinal imaging

2

Funding: NSF-IIS grant 1116718 and the Norman Hackerman Advanced Research Program

Samaniego, Adam, Vivek Boominathan, Ashutosh Sabharwal, and Ashok Veeraraghavan. “mobileVision: A Face-mounted, Voice-activated, Non-mydriatic Lucky Ophthalmoscope.” Wireless Health 2014.

Billions of Users

3

Src: http://www.emarketer.com/Article/Smartphone-Users-Worldwide-Will-Total-175-Billion-2014/1010536

Billions of Cameras

4

Src: http://www.emarketer.com/Article/Smartphone-Users-Worldwide-Will-Total-175-Billion-2014/1010536

Just an Image

5

Src: http://www.topconmedical.com/products/trcnw8highresolutionnonmydsystem.htm

Overview

• Unmet Healthcare Needs

• mobileVision System

• Emerging W.H. Ecosystem

6

Problem

• Diabetes: the leading cause of new U.S. cases of blindness among adults ages 20–74

• 80% Chance of developing diabetic retinopathy

• Complications are 90% preventable through early detection, but require frequent retinal screening

Src: http://diabetes.niddk.nih.gov/dm/pubs/statistics/#fast, scohen125 and calhoun16 on retinagallery.com

7

Problem

• Macular Degeneration: causes vision loss by destroying macula, ages 60+ at higher risk

• Global cost of over $300 Billion

• Can progress quickly and vision loss is irreversible; can be slowed if detected early, as by retinal screening

Src: http://www.myretinalinstitute.com/images/, https://www.nei.nih.gov/eyedata/amd.asp, http://www.eyeconsultants.net/UserFiles/severe_mac_gen.jpg

8

Topcon TRC-NW8

• ±45°field-of-view

• 24.5kg, > $10,000

• Easy to use

• Representative of clinical retinal imaging standard

Src: http://www.topconmedical.com/products/trcnw8highresolutionnonmydsystem.htm

9

mobileVision

• ±45°(stitched)

• 1kg, w/ smartphone

• Portable, face-mounted

• Algorithmic pipeline

• Improve robustness

• Mitigate artifacts

• Stitch final panorama

10

Optics: Overview

11

Fixation Targets

LED Coupled Fiber

Imaging Lenses

Left Eye

Right Eye

SmartphoneCamera

Illumination Lens

Mirror

CrossedPolarizers

User Interface

12

Example Images

13

Feature Matching

14

Single-view Fusion

15

Fused Views

16

Stitching

17

Stitching

18

Stitching

19

10°

±45°

Resolution Testing

20

Model Eye with USAF-1951 Res. Chart “retina”

Resolution Testing

21

Modulation Transfer Function (As simulated refractive error varies)

• Smartphone auto-focus allows for simulated refractive error between +13D and -6D

(23.5μm line width resolvable at 10% contrast)

Overview

• Unmet Healthcare Needs

• mobileVision System

• Emerging W.H. Ecosystem

22

W.H. Ecosystem

• Bastawrous et al.

• Peek Vision

• Pamplona et al.

• EyeNetra

• Myung et al.

23

Full references on “References” Slide

Not Just a Phone

24

References

• Samaniego, Adam, Vivek Boominathan, Ashutosh Sabharwal, and Ashok Veeraraghavan. "mobileVision: A Face-mounted, Voice-activated, Non-mydriatic Lucky Ophthalmoscope." Wireless Health 2014.

• Peek Vision. (2013). Retrieved October 20, 2014, from http://www.peekvision.org/• EyeNetra - Eye Care for 2.4 billion people in need. (2013, January 1). Retrieved October 20, 2014, from

http://eyenetra.com/product-netrag.html• Myung, David, Alexandre Jais, Lingmin He, Mark S. Blumenkranz, and Robert T. Chang. "3D Printed Smartphone Indirect Lens

Adapter for Rapid, High Quality Retinal Imaging." Journal of Mobile Technology in Medicine 3, no. 1 (2014): 9-15.

25

WLSACONVERGENCE SUMMIT

www.wirelesshealth2014.org