Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang,...

19
Multi-task Low-rank Affinity Multi-task Low-rank Affinity Pursuit for Image Segmentation Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented by Han Hu, I-vision Lab

Transcript of Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang,...

Page 1: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Multi-task Low-rank Affinity Pursuit Multi-task Low-rank Affinity Pursuit for Image Segmentationfor Image Segmentation

Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan

(ICCV’ 2011)

Presented by Han Hu, I-vision Lab

Page 2: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

ACM MM 2011We have six papers and one demo accepted to ACM MM 2011, with one full paper on Mul ti-Semantic Image Annotation. [08/08/2011]ICCV 2011We have six papers accepted to ICCV 2011, with one ORAL presentation from SONG Zheng and NI Bing bing on "Learning Universal Multi-view Age Estimator by Video Contexts". [07/23/2011]AAAI 2011Two papers on fea ture selection and block-di ag o nal regularization are accepted to AAAI'11. [04/28/2011]AISTATS 2011One paper from Xi ao tong Yuan is ac cept ed to International Con fer ence on Ar ti fi cial In tel li gence and Statis tics (AIS TATS). [03/07/2011]CVPR 2011Four papers are accepted to IEEE Con fer ence on Computer Vision and Pattern Recog ni tion (CVPR) 2011, including one oral pre sen ta tion. [03/07/2011]

Activity and event detection in images and videos Subspace learning and manifold learningTransductive learning, Transfer Learning Generic/Specific object detection, recognition and categorization Biometrics, Medical image processing

Shuicheng Yan

Page 3: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

The Goal and MotivationThe Goal and Motivation

Page 4: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Related WorksRelated WorksNormalized Cut (PAMI’00)Multi-view Spectral Clustering (ICML’07)

◦Create Independent Similarity Graphs◦Fuse Different Graphs

Page 5: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

The proposed MethodThe proposed MethodCreate Consistent Graphs

Page 6: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

The proposed MethodThe proposed MethodCreate Consistent Graphs

Page 7: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

SuperpixelsSuperpixels

Page 8: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

The proposed MethodThe proposed MethodCreate Consistent Graphs

Page 9: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Compute K Feature MatricesCompute K Feature MatricesColor HistogramLBPSIFT-BOW

Page 10: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

The proposed MethodThe proposed MethodCreate Consistent Graphs

Page 11: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Construct Similarity Graphs (1/2)Construct Similarity Graphs (1/2)

Single-Feature Case

Similarity:

[G. Liu et al, ICML’10]

Page 12: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Construct Similarity Graphs (2/2)Construct Similarity Graphs (2/2)

Multi-Feature Case

Similarity:

Page 13: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

L_2,1 NormL_2,1 Norm

Page 14: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Optimization (Augmented Lagrange Optimization (Augmented Lagrange Multiplier)Multiplier)

Page 15: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

OptimizationOptimization

Page 16: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

EvaluationEvaluationDatasets

◦MSRC (591 images)◦Berkeley (500 images)

Results

Page 17: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Qualitative ResultsQualitative Results

Page 18: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

Qualitative ResultsQualitative Results

Page 19: Multi-task Low-rank Affinity Pursuit for Image Segmentation Bin Cheng, Guangcan Liu, Jingdong Wang, Zhongyang Huang, Shuicheng Yan (ICCV’ 2011) Presented.

SummarySummaryClustering by Low Rank RepresentationL_2,1 NormA way to do fusion