Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview,...

19
Brain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Transcript of Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview,...

Page 1: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Brain-Computer InterfaceOverview, methods and opportunitiesEmtiyaz (Emt)CS, UBC

Page 2: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Overview• BCI : application, structure, challenges, opportunities• Two examples of BCI : P300 and ERD/ERS• ERD/ERS BCI – Methods• ERD/ERS BCI – Our Work

Page 3: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Please don’t sleep, we will watch videoshttp://www.youtube.com/watch?v=NIG47YgndP8

http://www.youtube.com/watch?v=qCSSBEXBCbY

Page 4: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Why a Brain-Computer Interface?1.Use the capabilities of remaining pathways2.Detour around the points of damage (FES)3.Or if you have enough time to kill, use BCI

Military Applications Other Fancy Use

Locked-in SyndromeAmyotrophic Lateral SclerosisMultiple Sclerosis

Image Bayliss’ Thesis, and various webpages

Page 5: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Why a Brain-Computer Interface?

Page 6: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

A General Brain-Computer Interface (BCI)

Image Pfurtscheller 2006

Evoked Potentials

Operant Conditions

Implanted Methods

Page 7: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

BCI: Challenges and Opportunities

Image Pfurtscheller 2006

Evoked Potentials

Operant Conditions

Implanted Methods

ChallengesHigh Signal VariabilityUnderlying Physics unknownLinear or nonlinear Model?Man-Machine learning dilemma

One obvious opportunityOptimization of Electrode position

P300

ERD/ERS

Page 8: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

P300 BCI

Images from http://ida.first.fraunhofer.de/projects/bci/competition_ii/albany_desc/albany_desc_ii.html

AverageBCI competetion II DatasetTask relevant stimuli

Non-task relevant response

Sequential data, Discrete o/p, Correlation based models

Page 9: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

ERD/ERS BCIAmplitude attenuation/ enhancementin the specific frequency bands

Photographs from Pfurscheller 2002

Sequential data, Continuos o/p,

Strong Spectral charasteristics

C3 C4

Page 10: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

ERD/ERS – Methods

Page 11: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Inter-trial Variance (IV) Method

Photographs from Pfurtscheller 1998

Only offline

Sensitive to frequency

band selection

Page 12: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

RLS ApproachAdaptive Autoregressive (AAR) Model

Solved with Recursive least square (RLS) algorithms and features classified with Linear Discriminant Analysis (LDA)

observation noise

Photographs from Pfurtscheller 2000

Page 13: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Our WorkDone at the Indian Institute of Science, Bangalore, Indiain 2002-04

PublishedM. E. Khan and D. N. Dutt, "An Expectation-Maximization Algorithm Based Kalman Smoother Approach for Event-Related Desynchronization(ERD) Estimation from EEG", Vol. 54, No. 7, July 2007, IEEE Transactions on Biomedical Engineering

Page 14: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Time-varying AR Model

RLS algorithm

Kalman filters

Use EM to get the parameters{A, Q, R, x0, S0)

EMKS

RLS

KS

Page 15: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Effect of EM Learning on Tracking

Average

Single TrialSignal

Optimization

Improved AR coefficientsTracking, and variance isreduced

Page 16: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Spectrum EstimationOptimization

Signal

Single Trial

Average

Improved Frequency TrackingVariance is reduced

Page 17: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Motor Imagery Data: Spectrum estimatesSignal

Single Trial Spectrum Estimate

Right Hand

Left Hand

Page 18: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Motor Imagery Data : ERD estimation

Page 19: Emtiyaz (Emt) CS, UBC - Emtiyaz Khan's Homepage · PDF fileBrain-Computer Interface Overview, methods and opportunities Emtiyaz (Emt) CS, UBC

Final Comments• BCI datasets provide opportunity to test new

algorithms• Every two year there is a BCI competition. Some free

datasets can be found there (just google BCI competition)

• Do it for fun and blame it on humanity!!