Post on 13-Feb-2017
MediaEval 2015 Workshop, Retrieving Diverse Social Images Task
14-15 September 2015, Wurzen, Germany
USEMP: Finding Diverse Images at MediaEval 2015
Eleftherios Spyromitros-Xioufis1, Adrian Popescu2,
Symeon Papadopoulos1, Yiannis Kompatsiaris1
1 CERTH-ITI, Thermi-Thessaloniki, Greece, {espyromi,papadop,ikom}@iti.gr 2 CEA, LIST, 91190 Gif-sur-Yvette, France, adrian.popescu@cea.fr
Summary of our participation
• supervised Maximal Marginal Relevance (sMMR) [1]:
– A supervised diversification method that jointly optimizes relevance and diversity
• The runs
– Fully automated, no external data*
– Each run corresponds to a different instantiation of sMMR
#2
Run id Run Type Relevance Features Diversity Features
1 visual-only CNN* [1] VLAD+CSURF [2]
2 text-only BOW BOW
3 & 5 visual+textual CNN, BOW, META VLAD+CSURF
[1] E. Spyromitros-Xioufis et al., “Improving diversity in image search via supervised relevance scoring”, ICMR 2015 [2] E. Spyromitros-Xioufis et al., “A comprehensive study over VLAD and Product Quantization in large-scale image retrieval”, IEEE Transactions on Multimedia, 2014
Learning relevance from ground truth
#6
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#7
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#8
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#9
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#10
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#11
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages