Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

19
Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen

Transcript of Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Page 1: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Learning from Multiple Outlooks

Maayan Harel and Shie MannorICML 2011

Presented by Minhua Chen

Page 2: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

What You Saw is Not What You Get: Domain Adaptation Using Asymmetric Kernel TransformsCVPR2011

Page 3: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Introduction• A learning task often relates to multiple

representations, or called domains, outlooks.• For example, in activity recognition, each user

(outlook) may use different sensors.• There are no sample correspondence, nor feature

correspondence across outlooks; only the label space (classification task) is shared.

• The goal is to use the information in all outlooks to improve learning performance.

• The approach is to map the data in one outlook (source) to another (target), so that the effective sample size is enlarged in the target domain.

Page 4: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Labeled data (*) and unlabeled data in the target domain (square)

Page 5: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Classifier trained on labeled data in the target domain

Page 6: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Labeled data from the source domain comes in (+).

Page 7: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

New classifier trained on both labeled target data and transferred source data.

Page 8: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Problem Formulation• The central question is how to map data from one domain

to the other, possibly with different feature dimensions.• The authors proposed an algorithm that computes

optimal affine mapping by matching moments of the empirical distribution for each class.

Source domain Target domain

Page 9: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Mathematical Solution

• Procrustes analysis can be applied to solve Ri.• The formulation can be extended to multiple outlooks:

Page 10: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Experiments• Activity recognition task with the following human

activities: walking, running, going upstairs, going downstairs, lingering.

• Data recorded by different users are regarded as different outlooks (domains), since the sensors used are different.

• Two setups are examined: domain adaptation with shared feature space, and multiple outlooks with different feature spaces.

• The authors tested the success of the mapping algorithm by classification of the target test data with a SVM classifier trained on the mapped source data.

Page 11: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

with the same feature space for all domains.

Page 12: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

with the same feature space for all domains.

Page 13: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.
Page 14: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.
Page 15: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

What You Saw is Not What You Get: Domain Adaptation Using Asymmetric Kernel

Transforms

B. Kulis, K. Saenko and T. Darrel, CVPR 2011

Page 16: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Main Idea

Page 17: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Kernelization

Page 18: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.
Page 19: Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.