Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara...
Transcript of Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara...
BrainsCanbeHacked.WhyShouldYouCare?
Tamara Bonaci DepartmentofElectricalEngineering
UniversityofWashington
TheEraofDevicesDevicesADachedtoUs
1/31/17
[Pictures credit: Forbes, US News, Wired]
2
DevicesADachedtoOurBrains
1/31/17
NielsenConsumerNeuroscience
NECOMIMINeuroSky
EPOCEmoJv
Newandupcomingproductsmakebrainmalwarepossible!
[Picture credit: forbes.com] [Picture credit: Lucid] [Picture credit: mindtecstore]
3
BrainMalware?
1/31/17
How Hackers Could Get Inside YourHead With ‘Brain Malware’
WRITTEN BY VICTORIA TURK (/AUTHOR/VICTORIATURK)
(/EN_US?TRK_SOURCE=HEADER-LOGO)
August 3, 2016 // 07:50 AM EST
Hackers have spyware in your mind. You’re minding your business, playing a game or
scrolling through social media, and all the while they’re gathering your most private
information direct from your brain signals. Your likes and dislikes. Your political
preferences. Your sexuality. Your PIN.
It’s a futuristic scenario, but not that futuristic. The idea of securing our thoughts is a
real concern (http://motherboard.vice.com/read/our-brains-will-be-hacked-tracked-
and-data-mined) with the introduction of brain-computer interfaces—devices that are
controlled by brain signals such as EEG (electroencephalography), and which are
already used in medical scenarios and, increasingly, in non-medical applications such
as gaming (http://motherboard.vice.com/blog/mind-control-is-going-mainstream).
Researchers at the University of Washington in Seattle say that we need to act fast to
implement a privacy and security framework to prevent our brain signals from being
used against us before the technology really takes off.
“There’s actually very little time,” said electrical engineer Howard Chizeck over Skype.
“If we don’t address this quickly, it’ll be too late.”
I first met Chizeck and fellow engineer Tamara Bonaci when I visited the University of
Washington Biorobotics Lab to check out their work on hacking teleoperated surgical
robots (http://motherboard.vice.com/read/surgery-robot-hacked-raven-ii). While I was
there, they showed me some other hacking research they were working on, including
how they could use a brain-computer interface (BCI), coupled with subliminal
messaging in a videogame, to extract private information about an individual.
How Hackers Could Get Inside YourHead With ‘Brain Malware’
WRITTEN BY VICTORIA TURK (/AUTHOR/VICTORIATURK)
(/EN_US?TRK_SOURCE=HEADER-LOGO)
4
WhatisBrainSpyware?AnymaliciousapplicaJonthatextractsprivateinformaJonaboutusersfromtheirneuralsignals[MarJnovicetal.,2012]
1/31/17
[Picture credit: University of Washington]
5
WhyDoesBrainSpywareWork?
1/31/17
SIGNAL ACQUISITION
Feature extraction
Classification algorithm
SIGNAL PROCESSING
BRAIN-COMPUTER INTERFACE
Digitized signal
Neuroprosthesis control
Neural signals
Neurogame control
Sensory feedback
Neural spelling
Neuroprosthesis
P300 Speller
Neurogame
ENGINEERINGPERSPECTIVE
6
WhyDoesBrainSpywareWork?
1/31/17
ENGINEERINGPERSPECTIVE
SIGNAL ACQUISITION
Feature extraction
Classification algorithm
SIGNAL PROCESSING
BRAIN-COMPUTER INTERFACE
Digitized signal
Neuroprosthesis control
Neural signals
Neurogame control
Sensory feedback
Neural spelling
Neuroprosthesis
P300 Speller
NeurogameExtracted private information
Malicious feature
extraction
Malicious classification
algorithm
Malicious BCIapplication
Malicious sensory feedback
7
WhyDoesBrainSpywareWork?
1/31/17
EventRelatedPotenJals(ERPs)-responsesassociatedwithspecificsensory,cogniJveandmotorevents
Time (milliseconds)
ERP
Ampl
itude
(μV)
0
2.5
5.0
7.5
-2.5
-5.0
-200 0 200 400 600 800
P300
N400
P600
ERN
Stimulus
NEURO-SCIENTIFICPERSPECTIVE
8
1/31/17
SubliminalBrainSpyware?
9
1/31/17
SubliminalBrainSpywareorSubliminalAlarm?
“Whatwedonotseeandwhatwedonotknowcanhurtus”
Brannon,199410
1/31/17
SubliminalSJmulaJon• ProcessofaffecJngpeoplewithsJmuliof
whichtheyarenotaware
11
1/31/17
HowFeasibleisSubliminalBrainSpyware?
Approach:ExperimentalanalysiswithhumansubjectsusingspeciallydevelopedBCI-game,Flappywhale
12
1/31/17
• Duringthegame:• 5differentsJmulipresentedonthescreenfor7ms• EachsJmulusrepeated10Jmes• Users’EEGsignalsrecordedusing7electrodes
HowFeasibleisSubliminalBrainSpyware?
13
1/31/17
Time[seconds]EEGsignal[scaledμV
]Time (milliseconds)
ERP
Ampl
itude
(μV)
0
2.5
5.0
7.5
-2.5
-5.0
-200 0 200 400 600 800
P300
N400
P600
ERN
Stimulus
DataPreparaJonandAnalysis
14
DataPreparaJonandAnalysis
1/31/17
EEGsignal[scaledμV
]
EEGsignal[scaledμV
]
Time[ms] Time[ms]
15
DataPreparaJonandAnalysis
1/31/17
Time (milliseconds)
ERP
Ampl
itude
(μV)
0
2.5
5.0
7.5
-2.5
-5.0
-200 0 200 400 600 800
P300
N400
P600
ERN
Stimulus
16
1/31/17
FeasibilityofSubliminalADacks
Trainingdata
TesJngdata
IdenJficaJonresult
SVMclassifierforprivatedataextracJon
FeatureextracJon(PrincipalComponent
Analysis)
FlappyWhale,BCI-controlledgame
TimesyncEEG&sJmuli;epochdata
TimesyncEEG&sJmuli;epochdata
FeatureextracJon(PrincipalComponent
Analysis)
Comparisonwithusers’self-reportedpost-gamesurveys
SubliminalinformaJon
extracJonresult
17
1/31/17
FeasibilityofSubliminalADacksGam
es
Subjects
TargetsGmulusrecognized
TargetsGmulusreportedbyasubjects
18
MiJgaJon-BCIAnonymizer
1/31/17
Idea:Neuralsignalsshouldbetreatedasauser’spersonallyidenJfiableinformaJon(PII)
vs.
[Picture credit: The Verge] [Picture credit: NeuroFocus]
19
1/31/17
BrainsCanbeHacked.WhatCanWeDo?
Understandsystem
UnderstandthreatsDevelop technical
approaches
Developnon-technicalapproaches
20
1/31/17
BrainsCanbeHacked.WhatCanWeDo?
Understandsystem
UnderstandthreatsDevelop technical
approaches
Developnon-technical
approaches
21
Acknowledgement• ThisprojectisacollaboraGveworkwith:
• Professors:RyanCalo,HowardJayChizeck,andTadayoshiKohno• Doctors:JeffreyHerron,CharlieMatlack,andRadRoberts• Graduatestudents:TimBrown,BradyHouston,TylerLibey,BrianMogen,PatrickMoore,
KatherinePraD,andMargaretThompson• Othercollaborators:MaDhewEhlert,EmilyMcReynolds,andHannahWerbel
• ThankyoutothemembersoftheUWBioRoboGcsLab,TechPolicyLab,andtheNSFCenterforSensorimotorNeuralEngineering
ThisprojectissupportedbytheNSFEngineeringResearchCenterforSensorimotorNeuralEngineering(Award#EEC1028725)andthegrantfromtheUWTechPolicyLab.
1/31/17 22