Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara...

23
Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington

Transcript of Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara...

Page 1: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

BrainsCanbeHacked.WhyShouldYouCare?

Tamara Bonaci DepartmentofElectricalEngineering

UniversityofWashington

Page 2: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

TheEraofDevicesDevicesADachedtoUs

1/31/17

[Pictures credit: Forbes, US News, Wired]

2

Page 3: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

DevicesADachedtoOurBrains

1/31/17

NielsenConsumerNeuroscience

NECOMIMINeuroSky

EPOCEmoJv

Newandupcomingproductsmakebrainmalwarepossible!

[Picture credit: forbes.com] [Picture credit: Lucid] [Picture credit: mindtecstore]

3

Page 4: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

BrainMalware?

1/31/17

How Hackers Could Get Inside YourHead With ‘Brain Malware’

WRITTEN BY VICTORIA TURK (/AUTHOR/VICTORIATURK)

(/EN_US?TRK_SOURCE=HEADER-LOGO)

August 3, 2016 // 07:50 AM EST

Hackers have spyware in your mind. You’re minding your business, playing a game or

scrolling through social media, and all the while they’re gathering your most private

information direct from your brain signals. Your likes and dislikes. Your political

preferences. Your sexuality. Your PIN.

It’s a futuristic scenario, but not that futuristic. The idea of securing our thoughts is a

real concern (http://motherboard.vice.com/read/our-brains-will-be-hacked-tracked-

and-data-mined) with the introduction of brain-computer interfaces—devices that are

controlled by brain signals such as EEG (electroencephalography), and which are

already used in medical scenarios and, increasingly, in non-medical applications such

as gaming (http://motherboard.vice.com/blog/mind-control-is-going-mainstream).

Researchers at the University of Washington in Seattle say that we need to act fast to

implement a privacy and security framework to prevent our brain signals from being

used against us before the technology really takes off.

“There’s actually very little time,” said electrical engineer Howard Chizeck over Skype.

“If we don’t address this quickly, it’ll be too late.”

I first met Chizeck and fellow engineer Tamara Bonaci when I visited the University of

Washington Biorobotics Lab to check out their work on hacking teleoperated surgical

robots (http://motherboard.vice.com/read/surgery-robot-hacked-raven-ii). While I was

there, they showed me some other hacking research they were working on, including

how they could use a brain-computer interface (BCI), coupled with subliminal

messaging in a videogame, to extract private information about an individual.

How Hackers Could Get Inside YourHead With ‘Brain Malware’

WRITTEN BY VICTORIA TURK (/AUTHOR/VICTORIATURK)

(/EN_US?TRK_SOURCE=HEADER-LOGO)

4

Page 5: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

WhatisBrainSpyware?AnymaliciousapplicaJonthatextractsprivateinformaJonaboutusersfromtheirneuralsignals[MarJnovicetal.,2012]

1/31/17

[Picture credit: University of Washington]

5

Page 6: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

WhyDoesBrainSpywareWork?

1/31/17

SIGNAL ACQUISITION

Feature extraction

Classification algorithm

SIGNAL PROCESSING

BRAIN-COMPUTER INTERFACE

Digitized signal

Neuroprosthesis control

Neural signals

Neurogame control

Sensory feedback

Neural spelling

Neuroprosthesis

P300 Speller

Neurogame

ENGINEERINGPERSPECTIVE

6

Page 7: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

WhyDoesBrainSpywareWork?

1/31/17

ENGINEERINGPERSPECTIVE

SIGNAL ACQUISITION

Feature extraction

Classification algorithm

SIGNAL PROCESSING

BRAIN-COMPUTER INTERFACE

Digitized signal

Neuroprosthesis control

Neural signals

Neurogame control

Sensory feedback

Neural spelling

Neuroprosthesis

P300 Speller

NeurogameExtracted private information

Malicious feature

extraction

Malicious classification

algorithm

Malicious BCIapplication

Malicious sensory feedback

7

Page 8: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

WhyDoesBrainSpywareWork?

1/31/17

EventRelatedPotenJals(ERPs)-responsesassociatedwithspecificsensory,cogniJveandmotorevents

Time (milliseconds)

ERP

Ampl

itude

(μV)

0

2.5

5.0

7.5

-2.5

-5.0

-200 0 200 400 600 800

P300

N400

P600

ERN

Stimulus

NEURO-SCIENTIFICPERSPECTIVE

8

Page 9: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

SubliminalBrainSpyware?

9

Page 10: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

SubliminalBrainSpywareorSubliminalAlarm?

“Whatwedonotseeandwhatwedonotknowcanhurtus”

Brannon,199410

Page 11: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

SubliminalSJmulaJon•  ProcessofaffecJngpeoplewithsJmuliof

whichtheyarenotaware

11

Page 12: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

HowFeasibleisSubliminalBrainSpyware?

Approach:ExperimentalanalysiswithhumansubjectsusingspeciallydevelopedBCI-game,Flappywhale

12

Page 13: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

•  Duringthegame:•  5differentsJmulipresentedonthescreenfor7ms•  EachsJmulusrepeated10Jmes•  Users’EEGsignalsrecordedusing7electrodes

HowFeasibleisSubliminalBrainSpyware?

13

Page 14: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

Time[seconds]EEGsignal[scaledμV

]Time (milliseconds)

ERP

Ampl

itude

(μV)

0

2.5

5.0

7.5

-2.5

-5.0

-200 0 200 400 600 800

P300

N400

P600

ERN

Stimulus

DataPreparaJonandAnalysis

14

Page 15: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

DataPreparaJonandAnalysis

1/31/17

EEGsignal[scaledμV

]

EEGsignal[scaledμV

]

Time[ms] Time[ms]

15

Page 16: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

DataPreparaJonandAnalysis

1/31/17

Time (milliseconds)

ERP

Ampl

itude

(μV)

0

2.5

5.0

7.5

-2.5

-5.0

-200 0 200 400 600 800

P300

N400

P600

ERN

Stimulus

16

Page 17: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

FeasibilityofSubliminalADacks

Trainingdata

TesJngdata

IdenJficaJonresult

SVMclassifierforprivatedataextracJon

FeatureextracJon(PrincipalComponent

Analysis)

FlappyWhale,BCI-controlledgame

TimesyncEEG&sJmuli;epochdata

TimesyncEEG&sJmuli;epochdata

FeatureextracJon(PrincipalComponent

Analysis)

Comparisonwithusers’self-reportedpost-gamesurveys

SubliminalinformaJon

extracJonresult

17

Page 18: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

FeasibilityofSubliminalADacksGam

es

Subjects

TargetsGmulusrecognized

TargetsGmulusreportedbyasubjects

18

Page 19: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

MiJgaJon-BCIAnonymizer

1/31/17

Idea:Neuralsignalsshouldbetreatedasauser’spersonallyidenJfiableinformaJon(PII)

vs.

[Picture credit: The Verge] [Picture credit: NeuroFocus]

19

Page 20: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

BrainsCanbeHacked.WhatCanWeDo?

Understandsystem

UnderstandthreatsDevelop technical

approaches

Developnon-technicalapproaches

20

Page 21: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

1/31/17

BrainsCanbeHacked.WhatCanWeDo?

Understandsystem

UnderstandthreatsDevelop technical

approaches

Developnon-technical

approaches

21

Page 22: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

Acknowledgement•  ThisprojectisacollaboraGveworkwith:

•  Professors:RyanCalo,HowardJayChizeck,andTadayoshiKohno•  Doctors:JeffreyHerron,CharlieMatlack,andRadRoberts•  Graduatestudents:TimBrown,BradyHouston,TylerLibey,BrianMogen,PatrickMoore,

KatherinePraD,andMargaretThompson•  Othercollaborators:MaDhewEhlert,EmilyMcReynolds,andHannahWerbel

•  ThankyoutothemembersoftheUWBioRoboGcsLab,TechPolicyLab,andtheNSFCenterforSensorimotorNeuralEngineering

ThisprojectissupportedbytheNSFEngineeringResearchCenterforSensorimotorNeuralEngineering(Award#EEC1028725)andthegrantfromtheUWTechPolicyLab.

1/31/17 22

Page 23: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices

Thankyou

1/31/17

Contact:[email protected]@tbonaci

23