Post on 08-Jan-2017
ProductPredictrWhat is Lynks shipping ?
Christopher Clive Bonnett
Plaid button-front shirt
Tommy Hilfiger striped shirt, bow-tie print
Image Text Label
Clothing >> Women >> Top
Clothing >> Kids >> Top
Unbalanced Classes
Classes
Counts
Convolution (Computer
Vision)
Image
Text
=
{
Predicted classification
The Algorithm
} Neural Network
Convolutional Neural Net
Computationally Expensive Data hungry
Leverage pre-trained convolutional part (Transfer learning)
VGG
Transfer learning Keep fixed
Image
Text-Bag of words
Predicted classification=
{
Trained { Trained}
The Algorithm
Classification Accuracy
Image
85%
Classification Accuracy
Text
86%Image
85%
Classification Accuracy
Image
85%Image + Text
93%Text
86%
Classification Accuracy
Image + Text
93%Image + Text + fine tuning
94%
Fine tuning
Allow weights in the last 2 convolutional-layer to be adjusted
+1%
blake cotton oxford shirt
Clothing >> Men >> TopClothing >> Kids >> Top
True Class Assigned Class
True Class Assigned Class
long lost cross back tank
Clothing >> Women >> Top Clothing >> Women >> Dress
Member of training data
In the training class
Not in training class
Member of training data
In the training class
Not in training class