E-commerce product classification with deep learning

17
ProductPredictr What is Lynks shipping ? Christopher Clive Bonnett

Transcript of E-commerce product classification with deep learning

Page 1: E-commerce product classification with deep learning

ProductPredictrWhat is Lynks shipping ?

Christopher Clive Bonnett

Page 2: E-commerce product classification with deep learning
Page 3: E-commerce product classification with deep learning

Plaid button-front shirt

Tommy Hilfiger striped shirt, bow-tie print

Image Text Label

Clothing >> Women >> Top

Clothing >> Kids >> Top

Page 4: E-commerce product classification with deep learning

Unbalanced Classes

Classes

Counts

Page 5: E-commerce product classification with deep learning

Convolution (Computer

Vision)

Image

Text

=

{

Predicted classification

The Algorithm

} Neural Network

Page 6: E-commerce product classification with deep learning

Convolutional Neural Net

Computationally Expensive Data hungry

Leverage pre-trained convolutional part (Transfer learning)

VGG

Page 7: E-commerce product classification with deep learning

Transfer learning Keep fixed

Image

Text-Bag of words

Predicted classification=

{

Trained { Trained}

The Algorithm

Page 8: E-commerce product classification with deep learning

Classification Accuracy

Image

85%

Page 9: E-commerce product classification with deep learning

Classification Accuracy

Text

86%Image

85%

Page 10: E-commerce product classification with deep learning

Classification Accuracy

Image

85%Image + Text

93%Text

86%

Page 11: E-commerce product classification with deep learning

Classification Accuracy

Image + Text

93%Image + Text + fine tuning

94%

Page 12: E-commerce product classification with deep learning

Blog: cbonnett.github.io http://bit.do/DarkEnerySurvey

Page 13: E-commerce product classification with deep learning

Fine tuning

Allow weights in the last 2 convolutional-layer to be adjusted

+1%

Page 14: E-commerce product classification with deep learning

blake cotton oxford shirt

Clothing >> Men >> TopClothing >> Kids >> Top

True Class Assigned Class

Page 15: E-commerce product classification with deep learning

True Class Assigned Class

long lost cross back tank

Clothing >> Women >> Top Clothing >> Women >> Dress

Page 16: E-commerce product classification with deep learning

Member of training data

In the training class

Not in training class

Page 17: E-commerce product classification with deep learning

Member of training data

In the training class

Not in training class