inria-00321048, version 2
Automatic Face Naming with Caption-based Supervision
Matthieu Guillaumin a, 1Thomas Mensink
1Jakob Verbeek
b, 1Cordelia Schmid
b, 1
IEEE Conference on Computer Vision & Pattern Recognition (CPRV '08) (2008) 1 - 8
Abstract: We consider two scenarios of naming people in databases of news photos with captions: (i) finding faces of a single person, and (ii) assigning names to all faces. We combine an initial text-based step, that restricts the name assigned to a face to the set of names appearing in the caption, with a second step that analyzes visual features of faces. By searching for groups of highly similar faces that can be associated with a name, the results of purely text-based search can be greatly ameliorated. We improve a recent graph-based approach, in which nodes correspond to faces and edges connect highly similar faces. We introduce constraints when optimizing the objective function, and propose improvements in the low-level methods used to construct the graphs. Furthermore, we generalize the graph-based approach to face naming in the full data set. In this multi-person naming case the optimization quickly becomes computationally demanding, and we present an important speed-up using graph-flows to compute the optimal name assignments in documents. Generative models have previously been proposed to solve the multi-person naming task. We compare the generative and graph-based methods in both scenarios, and find significantly better performance using the graph-based methods in both cases.
- a – Ecole Normale Supérieure de Paris - ENS Paris
- b – INRIA
- 1: LEAR (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
- CNRS : FR71 – CNRS : UMR5527 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)
- Domain : Computer Science/Learning
- Keywords : document handling – visual databases
- Available versions : v1 (2011-01-25) v2 (2011-04-11)
- inria-00321048, version 2
- http://hal.inria.fr/inria-00321048
- oai:hal.inria.fr:inria-00321048
- From: Jakob Verbeek
- Submitted on: Monday, 11 April 2011 14:28:47
- Updated on: Monday, 11 April 2011 14:32:36







Associated documents
See also
Export