Improving People Search Using Query Expansions: How Friends Help To Find People

Thomas Mensink 1 Jakob Verbeek 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper we are interested in finding images of people on the web, and more specifically within large databases of captioned news images. It has recently been shown that visual analysis of the faces in images returned on a text-based query over captions can significantly improve search results. The underlying idea to improve the text-based results is that although this initial result is imperfect, it will render the queried person to be relatively frequent as compared to other people, so we can search for a large group of highly similar faces. The performance of such methods depends strongly on this assumption: for people whose face appears in less than about 40% of the initial text-based result, the performance may be very poor. The contribution of this paper is to improve search results by exploiting faces of other people that co-occur frequently with the queried person. We refer to this process as 'query expansion'. In the face analysis we use the query expansion to provide a query-specific relevant set of 'negative' examples which should be separated from the potentially positive examples in the text-based result set. We apply this idea to a recently-proposed method which filters the initial result set using a Gaussian mixture model, and apply the same idea using a logistic discriminant model. We experimentally evaluate the methods using a set of 23 queries on a database of 15.000 captioned news stories from yahoonews. The results show that (i) query expansion improves both methods, (ii) that our discriminative models outperform the generative ones, and (iii) our best results surpass the state-of-the-art results by 10% precision on average.
Type de document :
Communication dans un congrès
David Forsyth and Philip Torr and Andre Zisserman. ECCV 2008 - 10th European Conference on Computer Vision, Oct 2008, Marseille, France. Springer, 5303, pp.86-99, 2008, Lecture Notes in Computer Science. <http://www.springer.com/computer/image+processing/book/978-3-540-88685-3>. <10.1007/978-3-540-88688-4_7>
Liste complète des métadonnées


https://hal.inria.fr/inria-00321045
Contributeur : Jakob Verbeek <>
Soumis le : lundi 11 avril 2011 - 12:50:27
Dernière modification le : mercredi 9 juillet 2014 - 16:43:24
Document(s) archivé(s) le : jeudi 30 mars 2017 - 09:25:53

Identifiants

Collections

Citation

Thomas Mensink, Jakob Verbeek. Improving People Search Using Query Expansions: How Friends Help To Find People. David Forsyth and Philip Torr and Andre Zisserman. ECCV 2008 - 10th European Conference on Computer Vision, Oct 2008, Marseille, France. Springer, 5303, pp.86-99, 2008, Lecture Notes in Computer Science. <http://www.springer.com/computer/image+processing/book/978-3-540-88685-3>. <10.1007/978-3-540-88688-4_7>. <inria-00321045v2>

Partager

Métriques

Consultations de
la notice

303

Téléchargements du document

355