IMA, March 12, 2003 Gert Lanckriet ( [email protected] )
-
Upload
noelani-mcconnell -
Category
Documents
-
view
38 -
download
1
description
Transcript of IMA, March 12, 2003 Gert Lanckriet ( [email protected] )
![Page 1: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/1.jpg)
IMA, March 12, 2003
Gert Lanckriet ([email protected])Nello Cristianini, Peter Bartlett, Laurent El Ghaoui, Michael
JordanU.C. Berkeley
Learning the Kernel Matrix with Semi-
Definite Programming
![Page 2: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/2.jpg)
Learning the Kernel Matrix with SDP
![Page 3: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/3.jpg)
Introduction: the idea (1)
Machine learning
Kernel-based machine learning
![Page 4: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/4.jpg)
Introduction: the idea (2)
![Page 5: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/5.jpg)
Introduction: the idea (3)
![Page 6: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/6.jpg)
training set (labelled)
test set (unlabelled)
Introduction: the idea (4)
![Page 7: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/7.jpg)
Introduction: the idea (5)
![Page 8: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/8.jpg)
Learning the Kernel Matrix with SDP
![Page 9: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/9.jpg)
Semi-Definite Programming (SDP)
![Page 10: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/10.jpg)
SDP - hard margin SVM classifiers (1)
![Page 11: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/11.jpg)
SDP - hard margin SVM classifiers (2)
![Page 12: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/12.jpg)
SDP - hard margin SVM classifiers (3)
![Page 13: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/13.jpg)
SDP - hard margin SVM classifiers (4)
![Page 14: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/14.jpg)
SDP - hard margin SVM classifiers (5)
![Page 15: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/15.jpg)
SDP - hard margin SVM classifiers (6)
![Page 16: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/16.jpg)
Reminder: Schur complement lemma
![Page 17: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/17.jpg)
SDP - hard margin SVM classifiers (7)
![Page 18: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/18.jpg)
SDP !
SDP - hard margin SVM classifiers (8)
![Page 19: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/19.jpg)
Learning the Kernel Matrix with SDP
![Page 20: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/20.jpg)
Optimization
Learning the kernel matrix !
Learning
LKM - hard margin SVM classifiers (1)
![Page 21: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/21.jpg)
training set (labelled)
test set (unlabelled)
Learning the kernel matrix !
LKM - hard margin SVM classifiers (2)
![Page 22: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/22.jpg)
?
LKM - hard margin SVM classifiers (3)
![Page 23: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/23.jpg)
LKM - hard margin SVM classifiers (4)
![Page 24: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/24.jpg)
LKM - hard margin SVM classifiers (4)
![Page 25: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/25.jpg)
LKM - hard margin SVM classifiers (4)
![Page 26: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/26.jpg)
LKM - hard margin SVM classifiers (5)
![Page 27: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/27.jpg)
LKM - hard margin SVM classifiers (6)
![Page 28: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/28.jpg)
LKM - hard margin SVM classifiers (7)
Learning Kernel Matrix with SDP !
![Page 29: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/29.jpg)
Learning the Kernel Matrix with SDP
![Page 30: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/30.jpg)
Empirical results hard margin SVMs
![Page 31: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/31.jpg)
Learning the Kernel Matrix with SDP
![Page 32: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/32.jpg)
Conclusions and future directions
![Page 33: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/33.jpg)
Conclusions and future directions
![Page 34: IMA, March 12, 2003 Gert Lanckriet ( gert@eecs.berkeley )](https://reader036.fdocuments.in/reader036/viewer/2022062314/56812d63550346895d927064/html5/thumbnails/34.jpg)
See also