EyePhone : Activating Mobile Phones With Your Eyes
description
Transcript of EyePhone : Activating Mobile Phones With Your Eyes
![Page 1: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/1.jpg)
EyePhone: Activating Mobile Phones With Your Eyes
Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell
CS Department – Dartmouth College, Hanover, NH, USA
![Page 6: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/6.jpg)
[email protected] Miluzzo
accelerometer
digital compass
microphone
WiFi/bluetooth GPS
light sensor/camera
gyroscope
air quality /pollution sensor
mobile phone sensing ….
![Page 7: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/7.jpg)
[email protected] Miluzzo
accelerometer
digital compass
microphone
WiFi/bluetooth GPS
light sensor/camera
gyroscope
air quality /pollution sensor
mobile phone sensing ….
light sensor/camera
![Page 8: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/8.jpg)
[email protected] Miluzzo
accelerometer
digital compass
microphone
WiFi/bluetooth GPS
light sensor/camera
gyroscope
air quality /pollution sensor
mobile phone sensing ….
light sensor/camera
camera
![Page 18: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/18.jpg)
[email protected] Miluzzo
• fairly ideal conditions for sensing
• array of sophisticated sensors
• subjects mostly static
• “sensing context” fairly constant
• subjects are on the move (video frames are blurred)
• limited sensing capabilities
• not ideal sensing context (dark, bright, etc.)
• hardware limitations
HPIHCI
![Page 20: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/20.jpg)
[email protected] Miluzzo
![Page 21: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/21.jpg)
[email protected] Miluzzo
mapping the position of the eye to an application icon on the phone display
![Page 22: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/22.jpg)
[email protected] Miluzzo
mapping the position of the eye to an application icon on the phone display
![Page 23: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/23.jpg)
[email protected] Miluzzo
mapping the position of the eye to an application icon on the phone display
![Page 29: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/29.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
![Page 30: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/30.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
running on pc running on the N810
![Page 31: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/31.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye tracking
![Page 32: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/32.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye tracking
on every frame
![Page 33: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/33.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
![Page 34: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/34.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
![Page 35: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/35.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
wink detection
![Page 36: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/36.jpg)
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
wink detectionbased on the correlation function values used in the
tracking phase
![Page 48: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/48.jpg)
[email protected] Miluzzo
let’s recap…smartphone’s computation capabilities
are growing
smarter open-eye template creation policies are needed(to be robust across different
context)
![Page 49: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/49.jpg)
[email protected] Miluzzo
let’s recap…smartphone’s computation capabilities
are growingsmarter open-eye template creation policies are
needed(to be robust across different context)
need for eye tracking techniques that are robust against context, mobility,
distance from display
![Page 50: EyePhone : Activating Mobile Phones With Your Eyes](https://reader035.fdocuments.in/reader035/viewer/2022062400/5681694e550346895de0ef0e/html5/thumbnails/50.jpg)
[email protected] Miluzzo
let’s recap…smartphone’s computation capabilities
are growingsmarter open-eye template creation policies are
needed(to be robust across different context)
need for eye tracking techniques that are robust against context, mobility, distance
from display more efficient false eye pair and “false” winks filtering to
avoid undesired app launches