DeeperVision and DeepInsight SolutionsJunjie Yan*, Naiyan Wang*, Yinan Yu, Linjiao Zhao, Stan Z. Li, Dit-Yan
Yeung
* denotes equal contribution
DeeperVision Classification
• Deeper network always helps
5 6 7 8 959
60
61
62
63
64
65
66
67
Top 1 Accuracy (single center test)
DeeperVision Classification
• Nesterov method based optimization • With large momentum and Nesterov based optimization method, the
algorithm could smooth out the optimization path.• It can improve top 1 accuracy by 0.8%
DeeperVision Classification
• More findings…• Slow down the speed of data abstraction (stride, kernel size, etc.)• More complicated data augmentations• Spatial Pyramid Pooling (SPP)
• Our final results• Single net: Top 5 error: 10.5%• Ensemble 5 nets: Top 5 error: 9.5%
Deep Insight Detection
Region proposal + CNN feature extraction• Selective Search + Structural Edge [1] for region proposal.• 7/8/9 Convolution Layers + SPM +2 Fully Connected Layers.• Deeper Models need more tuning iterations. • Better (Deeper) Classification CNN always helps Detection.
[1]C. Lawrence Zitnick and Piotr Dollár Edge Boxes: Locating Object Proposals from Edges ECCV 2014
Diagnosis Experiments (on 2013-val2 )
Original RCNN 31.4 + 9conv + SPM 36.6+ more iterations 39.2+ Structural Edge Proposal 40.1+ 7/8/9 Conv Ensemble 40.7 + CLS Context 42.0
Our Final Result
• We have the best single model (40.2 mAP V.S. the 38.0 mAP of GoogLeNet)• We use a non-optimal ensemble method when submitting result. A
better ensemble method leads to a 42.0 mAP on val2 after the competition.• Keeps improving…
Advertisement
• Junjie and I are looking for postdoc and job positions • Junjie Yan: http://www.cbsr.ia.ac.cn/users/jjyan/main.htm• Naiyan Wang: http://winsty.net
Top Related