Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision...
Transcript of Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision...
![Page 1: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/1.jpg)
Computer LearningGoing Forward
![Page 2: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/2.jpg)
Statistics
● Toronto Intro Stats● PSTAT 120A/B
![Page 3: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/3.jpg)
Linear Algebra / Multivariable Calculus
● MIT Linear Algebra● Math 108A/B● CCS Linear Algebra● MIT Multivariable Calculus● CCS Multidimensional Analysis
![Page 4: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/4.jpg)
Convex Optimization
● Convex 1● Convex 2● Stanford Lagunita● ECE 271 Principles of Opt.
![Page 5: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/5.jpg)
More Optimization
● Discrete Optimization● Berkeley Optimization
![Page 6: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/6.jpg)
Information Retrieval
Urbana Coursera
Stanford IR Course
![Page 7: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/7.jpg)
Machine Learning
● Oxford ML● UW Coursera ML● Stanford Grad ML● CMU Grad ML● Caltech ML
![Page 8: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/8.jpg)
Statistical Learning
● Stanford Statistical Learning● MIT Statistical Learning● Elements of Statistical Learning (Textbook)
![Page 9: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/9.jpg)
Probabilistic Graphical Models
● Stanford PGM's● CMU PGM's
![Page 10: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/10.jpg)
Clustering
● Urbana Clustering● CMU Grad ML
![Page 11: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/11.jpg)
Deep Learning I
● Hinton's Class● Deep Learning Summer School Slides● DLLS Videos● CS 290D (Xifeng)
![Page 12: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/12.jpg)
Deep Learning
● Deep Learning for NLP● Manning Tutorial Deep Learning for NLP● CS231n: Convolutional Neural Networks for Visual
Recognition
![Page 13: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/13.jpg)
Deep Learning Extras
● UFLDL Stanford● Github Deep Learning Reading List● Theano Python
![Page 14: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/14.jpg)
NLP
● Columbia NLP● Stanford NLP
○ Parsers, Grammar etc.● Stanford NLU
![Page 15: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/15.jpg)
Games
● General Game Playing● Game Theory Intro● Game Theory Advanced
![Page 17: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/17.jpg)
Conferences ML/ Deep Learning
● NIPS● IJCAI● AAAI● Sub-conferences
○ COLT
![Page 18: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/18.jpg)
Questions
CNN: What other applications can this be used for?
Independent of the data sets themselves, how much storage space do the bigger neural networks take up (e.g. storing all of the weights/parameters)? If any of you have used or are using neural networks, can you explain your project and why you chose to use a NN instead of some other method?
Figure 2: An illustration of the architecture of our CNN, explicitly showing the delineation of responsibilities between the two GPUs. One GPU runs the layer-parts at the top of the figure while the other runs the layer-parts at the bottom. The GPUs communicate only at certain layers. The network’s input is 150,528-dimensional, and the number of neurons in the network’s remaining layers is given by 253,440–186,624–64,896–64,896–43,264– 4096–4096–1000.
![Page 19: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/19.jpg)
Our Faculty
Faculty
Ece
Grad Colloquium
![Page 20: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/20.jpg)
Class Stats
Easiest Class: 2.375 = Probability Review2.5 Basic Text Processing = Edit Distance
Hardest Class:4 = Optimization = CNN3.625 Statistical Decision Theory = Word Embedding = Deep Learning I
Most Boring:3.125 = Linear Algebra Review3.25 = Linear Algebra Advanced
Most Fascinating:4.5 = Deep Learning II4.375 = Deep Learning I
Overall Score: 4.625
![Page 21: Computer Learningcomputer-learning.github.io/class/Slides/Computer... · 3.625 Statistical Decision Theory = Word Embedding = Deep Learning I Most Boring: 3.125 = Linear Algebra Review](https://reader034.fdocuments.in/reader034/viewer/2022051922/60101bfb0ad64527bf5e4e95/html5/thumbnails/21.jpg)
Thanks!!!