Automatic Face Naming with Caption-based Supervision

Matthieu Guillaumin 1 Thomas Mensink 1 Jakob Verbeek 1 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We consider two scenarios of naming people in databases of news photos with captions: (i) finding faces of a single person, and (ii) assigning names to all faces. We combine an initial text-based step, that restricts the name assigned to a face to the set of names appearing in the caption, with a second step that analyzes visual features of faces. By searching for groups of highly similar faces that can be associated with a name, the results of purely text-based search can be greatly ameliorated. We improve a recent graph-based approach, in which nodes correspond to faces and edges connect highly similar faces. We introduce constraints when optimizing the objective function, and propose improvements in the low-level methods used to construct the graphs. Furthermore, we generalize the graph-based approach to face naming in the full data set. In this multi-person naming case the optimization quickly becomes computationally demanding, and we present an important speed-up using graph-flows to compute the optimal name assignments in documents. Generative models have previously been proposed to solve the multi-person naming task. We compare the generative and graph-based methods in both scenarios, and find significantly better performance using the graph-based methods in both cases.
Type de document :
Communication dans un congrès
CVPR 2008 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2008, Anchorage, United States. IEEE Computer society, pp.1-8, 2008, <http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4587603>. <10.1109/CVPR.2008.4587603>
Liste complète des métadonnées


https://hal.inria.fr/inria-00321048
Contributeur : Jakob Verbeek <>
Soumis le : lundi 11 avril 2011 - 14:28:47
Dernière modification le : mercredi 9 juillet 2014 - 16:43:20
Document(s) archivé(s) le : samedi 3 décembre 2016 - 23:12:32

Identifiants

Collections

Citation

Matthieu Guillaumin, Thomas Mensink, Jakob Verbeek, Cordelia Schmid. Automatic Face Naming with Caption-based Supervision. CVPR 2008 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2008, Anchorage, United States. IEEE Computer society, pp.1-8, 2008, <http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4587603>. <10.1109/CVPR.2008.4587603>. <inria-00321048v2>

Partager

Métriques

Consultations de
la notice

377

Téléchargements du document

2664