Linear Classifiers & Classification Lecture...

Lecture 15 - 15-Nov-2016

Lecture 15: Linear Classifiers & Classification

1


Linear Regression

2

Slide Credit: Iasonas Kokkinos


Linear Regression

3



Linear Regression

4

Slide Credit: Pedro Domingoss


Linear Regression

5



Linear Regression

6



Linear Regression

7



Linear Regression

8



Linear Regression

Why not closed form?

9


Linear Regression

Example

Y = X

w = 0

1. p = 1 -> 11.1. w’ = lr*1

2. p = -1 -> -12.1. w’ = lr*1

3. p = 2 -> 23.1. w’ = lr*4

10


Linear Regression

11



Linear Regression

What can we learn?

12


Linear Regression

● XOR Example○ Picture○ Logic “features”○ Layers

● Why “layers”?

13


Linear Regression

14



Linear Regression

15



Linear Regression

16



Linear Regression

17



Model Complexity

18



Linear Regression

19



Images?

20

Slide Credit: CS231N


Images?

21



Images?

22



Images?

23



Images?

24



Images?

25



Images?

26



Images?

27



Images?

28



Images?

29



Images?

30



Images?

31



Images?

32



Images?

33



Decision Trees

34


Decision Trees

35


XOR Example

Documents