COMP 441: Large Scale Machine Learning - Rice...

9
COMP 441: Large Scale Machine Learning Rice University Anshumali Shrivastava anshumali At rice.edu 11th Janauary 2016 Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 1/9

Transcript of COMP 441: Large Scale Machine Learning - Rice...

Page 1: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

COMP 441: Large Scale Machine Learning

Rice University

Anshumali Shrivastava

anshumali At rice.edu

11th Janauary 2016

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 1 / 9

Page 2: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

About

Instructor : Anshumali Shrivastava

Email : anshumali AT rice.edu

Class Timing: Monday/Wednesday/Friday 11am to 11:50am

Class Location : AEL B209

Office Hours : Monday and Wednesday 11:50am to 12:30am ,Duncan Hall 3118

Website: http:

//www.cs.rice.edu/~as143/COMP441_Spring16/index.html

Piazza: https://piazza.com/class#fall2016/comp441

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 2 / 9

Page 3: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

Grading Total (105%)

Project 50%

5 bi-weekly assignments (Best 4 will be considered) 25%

2 Quizzes 15%

2 Scribes 10%

Participation and Discussion Forums 5%

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 3 / 9

Page 4: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

Project Logistics

Individual Projects (with permission can make a group of at max 2).

Proposals Due: 15th Feb.

Midterm Presentation with Report: 14th March

Final Presentation: 22nd April

Final Reports Due: 1st May

Ideal Possibilities (any of the following)

Improvement over state-of-art with publishable benchmarks.

A publicly releasable code for a common machine learning task(usually distributed implementation). (Make a startup out of it)

New theoretical insights or analysis.

Promise on a new problem (usually with new data).

A thorough empirical comparison report of at least 5-10 methods on5-10 different problems.

Ideally publishable in ICML, NIPS, KDD, etc.

Most Important Component of Class, Start Now!

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 4 / 9

Page 5: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

Other Requirements

Assignments

5 bi-weekly assignments. Due on Friday in Class.

Best 4 will be counted.

Scribes

Each student will scribe 2 lectures.

Choose dates soon. Need a volunteer for the next class.

LaTeX template on Website.

Exams

2 in Class Quizzes.

No Finals.

No mid-terms.

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 5 / 9

Page 6: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

Some ProblemsHow can we search through billions of webpages quickly ?

What goes behind recommendations engines ?

Deep Learning.

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 6 / 9

Page 7: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

Some Problems Contd.

How can we predict structures, like machine translation or compoundstructure?

How to deal with massive Graphs ?

Many More.

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 7 / 9

Page 8: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

What we will try to cover.

Sketching and Streaming.

Hashing and Randomized Algorithms.

Optimization for Big-Data.

Ensemble Classification.

Kernels.

Structured Prediction.

Graphical Models and Variational Inference.

Recommender Systems.

Mining Massive Graphs.

Deep Learning.

Online Learning and Multi Arm Bandits.

Distributed Machine Learning.

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 8 / 9

Page 9: COMP 441: Large Scale Machine Learning - Rice Universityas143/COMP441_Spring16/Lectures/01_11.… · 5 bi-weekly assignments. Due on Friday in Class. Best 4 will be counted. Scribes

Next : Some Probability

Rice University (COMP 441) Introduction and Logistics 11th Janauary 2016 9 / 9