MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ......

20
MoLe: Motion Leaks through Smartwatch Sensors Presented by Michael Mahler

Transcript of MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ......

Page 1: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

MoLe: Motion Leaks through Smartwatch Sensors

Presented by Michael Mahler

Page 2: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great
Page 3: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Introduction - Background

● Modern smartwatches have full suite of motion sensing chips

● Great for counting steps, monitoring sleep, etc

● Opens up a potential side-channel attack

● NOT the goal of MoLe: prove that leaks are possible

● Goal of MoLe: determine to what extent the leaks are possible

Page 4: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great
Page 5: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Introduction - Related Work

● Using the accelerometer and gyroscope, is it possible to infer keystrokes?

● Related work suggests it’s doable

● (sp)iPhone

● TouchLogger

Page 6: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Introduction - Why It’s Hard

● Data from right hand is absent

● Not everyone uses the same fingers for the same keys

● People type at different speeds (faster and fainter is obviously harder)● Motion data is dependent on the last key pressed - so incorrectly classifying

one key could throw off all subsequent keypresses

Page 7: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Data Exploration

Page 8: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Data Exploration

Page 9: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

System Overview

Page 10: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

System Design - Keystroke Detector

Page 11: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

System Design - Cloud Fitting

Page 12: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation

● How well can MoLe guess each word?

● What affects its effectiveness?

● Should humans be used in this system?

● Threat prevention

Page 13: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Overall Effectiveness

● 30% chance that MoLe would narrow down a typed word to only 5 possibilities

● 50% chance to only 24 possibilities

Fairly brute-forceable now

Page 14: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Impacts of Variables

● Word Length - longer words are generally easier to classify

● Number of Left-hand Chars in a Word

● Sampling Rate

Page 15: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Human Intervention

● Given a list of possible words in a sentence, how hard would it be for a human to guess the phrase?

● Is this really feasible?

Page 16: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Evaluation - Threat Prevention

● Detect typing events and throttle the accelerometer to ~ 30Hz● Only let the OS handle the raw data. Apps can only see analytics about the

data (i.e. “steps taken today” or “activity level in the past hour”)

● Could apply some sort of differential privacy algorithm

Page 17: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Some Good Things

● Authors very up-front about the limitations of MoLe

● Authors used real people to test MoLe

● A lot of good evaluation-based questions were answered

Page 18: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Criticisms

● Sampling at 200Hz - Data size/throughput/storage isn’t talked about

● No other ML techniques used or considered

● Authors too hard on themselves- MoLe could easily be deployed IRL

Page 19: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great
Page 20: MoLe: Motion Leaks through Smartwatch Sensors · MoLe: Motion Leaks through Smartwatch Sensors. ... - Background Modern smartwatches have full suite of motion sensing chips Great

Discussion