Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students -...
Transcript of Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students -...
![Page 1: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/1.jpg)
Pattern Recognition in EEG
Pieter-Jan Kindermans, UGent, Department of Electronics and Information Systems (ELIS)
1
![Page 2: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/2.jpg)
Who is familiar with machine learning?
2
![Page 3: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/3.jpg)
Who is familiar with MATLAB?
3
![Page 4: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/4.jpg)
Who knows how to program?
4
![Page 5: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/5.jpg)
We are
Thibault Verhoeven, Pieter-Jan Kindermans
- Faculty of engineering and architecture
- Department of Electronics and Information Systems (ELIS)
- Reservoir Lab (a Machine learning group)
- PhD students
- Work on/related to Brain-Computer Interfaces
5
![Page 6: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/6.jpg)
To illustrate basic machine learning principles
6
![Page 7: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/7.jpg)
Outline
- Event-Related Potential classification (the task)
- Machine learning methods (the basic tools)
- Unsupervised classification in BCI (advanced tools)
- The hands on session (the work)
- Your own data?
7
![Page 8: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/8.jpg)
Event-Related Potential classification (the task)
focus on ERPs in Brain-Computer Interfaces
8
![Page 9: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/9.jpg)
Application: Brain-Computer Interfaces
9
![Page 10: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/10.jpg)
Event-Related Potentials (Oddball paradigm)
10
Stimuli
0 0.2 0.4 0.6 0.8 1−0.1
−0.05
0
0.05
0.1
0.15
time (s)
P300NON−P300
![Page 11: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/11.jpg)
ERP based BCI
11
![Page 12: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/12.jpg)
General principle behind ERP based BCI
12
Stimulus 1
EEG/ Response
![Page 13: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/13.jpg)
General principle behind ERP based BCI
13
Stimulus 1
EEG/ Response
2
![Page 14: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/14.jpg)
General principle behind ERP based BCI
14
Stimulus 1
EEG/ Response
2 3
![Page 15: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/15.jpg)
General principle behind ERP based BCI
15
Stimulus 1
EEG/ Response
2 3
1 iteration
![Page 16: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/16.jpg)
General principle behind ERP based BCI
16
Stimulus 1
EEG/ Response
2 3 3 1 2
1 iteration
![Page 17: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/17.jpg)
General principle behind ERP based BCI
17
Stimulus 1
EEG/ Response
2 3 3 1 2 3 21
1 iteration
![Page 18: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/18.jpg)
General principle behind ERP based BCI
18
Stimulus 1
EEG/ Response
2 3 3 1 2 3 21
1 iteration
1 trial
![Page 19: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/19.jpg)
General principle behind ERP based BCI
19
Stimulus 1
EEG/ Response
2 3 3 1 2 3 21
Attended stimulus?
1 iteration
1 trial
![Page 20: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/20.jpg)
ERP variations
All these variations exhibit the same stimulus/iteration structure
- Visual speller
- Auditory (e.g. Amuse, PASS2D)
- Tactile
- ...
20
![Page 21: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/21.jpg)
Example: auditory ERPs
21
A - supervised blocks
�100 0 100 200 300 400 500 600 700 800�2
0
2
[µV
]
tnt
[µV
]
�2
0
2
[µV
]
tnt
130 � 160 [ms] 180 � 240 [ms] 260 � 280 [ms] 300 � 350 [ms] 420 � 460 [ms]
�0.1
�0.05
0
0.05
0.1
( t ,
nt )
ssA
UC
�100 0 100 200 300 400 500 600 700 800�2
0
2
[µV
]
tnt
130 � 160 [ms] 180 � 240 [ms] 260 � 280 [ms] 300 � 350 [ms] 420 � 460 [ms]
�2
0
2
ssAUC
tnt
( t ,
nt )
ssA
UC
B - unsupervised blocks
Cz (thick)
F5 (thin)
time [ms] time [ms]
![Page 22: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/22.jpg)
Many differences between subjects
22
Time after stimulus [ms]
100
faw
fcb
150 200 250 300 350 400 600500
GA
![Page 23: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/23.jpg)
Unfortunately, the raw data looks like this
23
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
![Page 24: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/24.jpg)
ERP Speller: The default approach
1. Record training data (quite boring)
2. Machine learning magic (supervised)
3. Use the BCI
24
![Page 25: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/25.jpg)
Questions?
25
![Page 26: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/26.jpg)
We will build a decoder to discriminate between target and non-target ERP responses
It is already implemented. If you get bored, you can extend the implementation such that it predicts the symbols as well.
26
![Page 27: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/27.jpg)
Machine learning methods (the basic tools)
27
![Page 28: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/28.jpg)
Machine learning rules
- Do not optimise the model on the data used for evaluation
28
![Page 29: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/29.jpg)
Machine learning rules
- Do not optimise the model on the data used for evaluation
- Keep the model as simple as possible
29
![Page 30: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/30.jpg)
Machine learning rules
- Do not optimise the model on the data used for evaluation
- Keep the model as simple as possible
- Use a proper cost function
30
![Page 31: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/31.jpg)
Machine learning rules
- Do not optimise the model on the data used for evaluation
- Keep the model as simple as possible
- Use a proper cost function
- Do not directly interpret the classifier weights
31
![Page 32: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/32.jpg)
Linear Discriminant Analysis
Pictures from Pattern Recognition and Machine Learning (C. Bishop)
32
![Page 33: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/33.jpg)
Linear Discriminant Analysis
Pictures from Pattern Recognition and Machine Learning (C. Bishop)
33
![Page 34: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/34.jpg)
Linear Discriminant Analysis
34
p(x|C1) =
1
(2⇡)D2
1
|⌃| 12exp(�1
2
(x� µ1)T⌃
�1(x� µ1))
p(x|C2) =
1
(2⇡)D2
1
|⌃| 12exp(�1
2
(x� µ2)T⌃
�1(x� µ2))
p(C1) = ⇡C1, 0 ⇡C1 1
p(C2) = 1� ⇡C1
![Page 35: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/35.jpg)
Linear Discriminant Analysis
35
wx+ w0 > 0
w = ⌃
�1(µ1 � µ2)
w0 = �1
2
µ1T⌃
�1µ1 +
1
2
µ
T2 ⌃
�1µ2 + log
p(C1)
p(C2)
![Page 36: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/36.jpg)
Linear Discriminant Analysis
36
wx+ w0 > 0
w = ⌃
�1(µ1 � µ2)
w0 = �1
2
µ1T⌃
�1µ1 +
1
2
µ
T2 ⌃
�1µ2 + log
p(C1)
p(C2)
−20 0 20
−20
−10
0
10
20
−20 0 20
−20
−10
0
10
20
−20 0 20
−20
−10
0
10
20
![Page 37: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/37.jpg)
Linear Discriminant Analysis
37
wx+ w0 > 0
w = ⌃
�1(µ1 � µ2)
w0 = �1
2
µ1T⌃
�1µ1 +
1
2
µ
T2 ⌃
�1µ2 + log
p(C1)
p(C2)
−10 0 10
−10
−5
0
5
10
−10 0 10
−10
−5
0
5
10
−10 0 10
−10
−5
0
5
10
![Page 38: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/38.jpg)
Overfitting and regularisation
38
model complexity complexity
Erro
r
Train errorTest errorOptimum
![Page 39: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/39.jpg)
Regularisation for LDA
Estimating covariance matrices is difficult (especially for high dimensions) Shrinkage regularisation
!
Effect: the weight vector becomes equal to the difference between the class means:
39
w = ⌃̂�1(µ1 � µ2)
⌃̂ = ⌃+ �I
![Page 40: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/40.jpg)
Training and testing
40
data
train validation
fold 1fold 2fold 3fold 4fold 5
test
![Page 41: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/41.jpg)
Training and testing
41
data
train validation
fold 1fold 2fold 3fold 4fold 5
test
![Page 42: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/42.jpg)
Crossvalidation
42
data
train test
fold 1fold 2fold 3fold 4fold 5
![Page 43: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/43.jpg)
Nested crossvalidation
43
data
train test
fold 1fold 2fold 3fold 4fold 5
data
train validation
subfold 1subfold 2subfold 3subfold 4
For all the inner folds
![Page 44: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/44.jpg)
The importance of multivariate interactions
44
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2−40
−20
0
20
40
signaal
tijd
0 0.2 0.4 0.6 0.8 1−0.1
−0.05
0
0.05
0.1
0.15
time (s)
P300NON−P300
![Page 45: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/45.jpg)
The importance of multivariate interactions
45
−10 0 10
−10
−5
0
5
10
−10 0 10
−10
−5
0
5
10
−10 0 10
−10
−5
0
5
10
![Page 46: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/46.jpg)
The importance of multivariate interactions
46
−10 0 10
−10
−5
0
5
10
−10 0 10
−10
−5
0
5
10
−10 0 10
−10
−5
0
5
10
0 0.2 0.4 0.6 0.8 1−0.1
−0.05
0
0.05
0.1
0.15
time (s)
P300NON−P300
![Page 47: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/47.jpg)
The importance of multivariate interactions
47
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
�
���� ����
����� ����
�
��������
�
![Page 48: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/48.jpg)
The importance of multivariate interactions
48
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
�
���� ����
����� ����
�
��������
�
![Page 49: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/49.jpg)
The importance of multivariate interactions
49
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
�
���� ����
����� ����
�
��������
�
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
�
���� ����
����� ����
�
��������
�
![Page 50: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/50.jpg)
The importance of multivariate interactions
50
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
�
���� ����
����� ����
�
��������
�
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
����� ����
����� ����
�
��������
�
�� �� � � ���
��
�
�
�� �� � � ���
��
�
�
������
�����
���������
��������� ������� ������������ ����� �������������
�������
���������
�����
�� � ��
��
���
����������������������������
�������������������������������
������������� ������������
��������
��
���� ���� �
�� ��
������� ���� ��
������� ���� ��
��������
�
���� ����
����� ����
�
��������
�
![Page 51: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/51.jpg)
Error measures
Computing the accuracy is simple, just count how many examples you have classified correctly!
51
![Page 52: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/52.jpg)
Error measures
Computing the accuracy is simple, just count how many examples you have classified correctly!
Yes, but …
What if the data is such that 99% of the samples are belonging to the non-target class. If I constantly predict non-target, this will be a good model.
52−20 0 20
−20
−10
0
10
20
−20 0 20
−20
−10
0
10
20
−20 0 20
−20
−10
0
10
20
![Page 53: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/53.jpg)
Images: wikipedia
53
![Page 54: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/54.jpg)
Error measures
True positive rate (or sensitivity, recall):
!
True negative rate (or specificity)
!
False positive rate
54
TPR =TP
P
FPR =FP
N
TNR =TN
N
![Page 55: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/55.jpg)
Error measures: balanced accuracy
True positive rate (or sensitivity, recall):
!
True negative rate (or specificity)
!
!
Possible to combine TPR and TNR in a balanced accuracy by averaging.
55
TPR =TP
P
TNR =TN
N
![Page 56: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/56.jpg)
Error measures: area under curve
56
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
false positive rate
true
posi
tive
rate
![Page 57: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/57.jpg)
Questions?
57
![Page 58: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/58.jpg)
The hands on session (the work)
58
![Page 59: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/59.jpg)
Data
- Visual ERP data (6x6) matrix speller
- 1:5 ratio of target to non-targets
- 15 iterations
- 12 stimuli per iteration
- 64 channels at 240 Hz
59
![Page 60: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/60.jpg)
Find the target samples!
60
![Page 61: Pattern Recognition in EEG - UGent · - Reservoir Lab (a Machine learning group) - PhD students - Work on/related to Brain-Computer Interfaces 5. To illustrate basic machine learning](https://reader033.fdocuments.in/reader033/viewer/2022050116/5f56f6eb55996a75c46f84ea/html5/thumbnails/61.jpg)
Feedback
61