Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course...
Transcript of Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course...
![Page 1: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/1.jpg)
Liangliang Cao 1
Deep Learning
in Computer Vision and NLP
Liangliang Cao
James Fan
http://llcao.net/cu-deeplearning15/
![Page 2: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/2.jpg)
Liangliang Cao 2
Introduction
![Page 3: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/3.jpg)
Liangliang Cao
Teaching Assistant (to be confirmed)
• Colin Abraham Raffel
3
http://colinraffel.com/
You have to reconstruct his face when you
interact with him online (say, Google group)
![Page 4: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/4.jpg)
Liangliang Cao
Course Website and Google Group
http://llcao.net/cu-deeplearning15/
4
• Course schedule and slides will be put on the website
• “Resource” page under construction.
![Page 5: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/5.jpg)
Liangliang Cao
Office Hour vs. Google Group
• No fixed office hour
– But you are welcome to stay after the course and ask questions
• Google group of this course
5
https://groups.google.com/forum/#!forum/ee6894-deep-learning
![Page 6: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/6.jpg)
Liangliang Cao
Course Content and Schedule
• Introduction to Watson Jeopardy! and Deep Learning
• Programming Guide
• Deep Learning and Computer Vision
• Deep Learning and NLP
• Student Presentations and Course Projects
6
![Page 7: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/7.jpg)
Liangliang Cao
Why We Choose This Schedule
• Why Theano instead of other deep learning toolkit?
– Theano can be used with both GPU and CPU
– Theano can be used for both vision and NLP (or other apps)
– Limitations of Theano
• How to give you enough hands-on experience?
– Quick programming tour
– In class programming competition
– Course projects (team size to be announced)
– In class student presentations
7
![Page 8: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/8.jpg)
Liangliang Cao
Detailed Schedule
http://llcao.net/cu-deeplearning15/
8
![Page 9: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/9.jpg)
Liangliang Cao
Projects
What kind of projects would you like to take in this class?
1. NLP
2. Vision
3. NLP + Vision
4. Your own data or problem?
9
In the next class we will listen to your ideas and suggest some project ideas.
![Page 10: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/10.jpg)
Liangliang Cao
Project Requirements
One group of 3 students should finish their project with the
following checkpoints:
• 2/18: Midterm project proposal
– Every team prepares a 10 min presentation
– Slides due on 2/17
• 4/22 and 4/29: Final project presentation
– Every team prepares a 20-30 min presentation
– Slides due on 4/21
• 5/10: Final project report due
– 4+ pages report, in the format of top conferences (e.g., ACL or
ICCV)
10
![Page 11: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/11.jpg)
Liangliang Cao
Student Paper Presentation
• Student should prepare to present the papers in one of
the following topics:
• We encourage students choose a topic which is related to
their project
• Register presentation slots between Jan 28 and Feb 18
(First come first fill)
11
1. Word embedding
2. Syntax and semantics
3. NLP applications
4. Large Scale Image/Video
5. Face
6. OCR
![Page 12: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/12.jpg)
Liangliang Cao
Be A Good Collaborator and An Honest Learner
• We hope you enjoy this class as a team learning process
– Be devoted in collaboration
– Be on time for discussion or delivery
– Learn from your teammates
• Please do not copy homework/slides/reports
– It is easy to find out by your peers or search engines
– You may have trouble with university rules
– And you lose the chance of learning or doing by yourself
12
![Page 13: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/13.jpg)
Liangliang Cao
Course Requirement
• Knowledgeable about NLP and/or vision and/or
machine learning
• Fluent in Python and Numpy programming
Students will be strongly advised to drop the class if
they cannot finish the first homework on time.
13
![Page 14: Deep Learning in Computer Vision and NLP - …llcao.net/cu-deeplearning15/pdf/1 course introduction.pdfLiangliang Cao Why We Choose This Schedule •Why Theano instead of other deep](https://reader034.fdocuments.in/reader034/viewer/2022042312/5edacb29a22bb1624d6d8f88/html5/thumbnails/14.jpg)
Liangliang Cao 14
First Homework
Submit by Emailing• [email protected]
before the 2nd class ( Jan. 28)