Automatic Face Naming with Caption-based Supervision - Archive ouverte HAL Access content directly
Conference Papers Year : 2008

Automatic Face Naming with Caption-based Supervision

Thomas Mensink
  • Function : Author
  • PersonId : 853681
Jakob Verbeek
Cordelia Schmid
  • Function : Author
  • PersonId : 831154


We consider two scenarios of naming people in databases of news photos with captions: (i) finding faces of a single person, and (ii) assigning names to all faces. We combine an initial text-based step, that restricts the name assigned to a face to the set of names appearing in the caption, with a second step that analyzes visual features of faces. By searching for groups of highly similar faces that can be associated with a name, the results of purely text-based search can be greatly ameliorated. We improve a recent graph-based approach, in which nodes correspond to faces and edges connect highly similar faces. We introduce constraints when optimizing the objective function, and propose improvements in the low-level methods used to construct the graphs. Furthermore, we generalize the graph-based approach to face naming in the full data set. In this multi-person naming case the optimization quickly becomes computationally demanding, and we present an important speed-up using graph-flows to compute the optimal name assignments in documents. Generative models have previously been proposed to solve the multi-person naming task. We compare the generative and graph-based methods in both scenarios, and find significantly better performance using the graph-based methods in both cases.
Vignette du fichier
GMVS08.png (150.47 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
verbeek08cvpr.pdf (1.7 Mo) Télécharger le fichier
GMVS08.poster.pdf (911.88 Ko) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Format : Other

Dates and versions

inria-00321048 , version 1 (25-01-2011)
inria-00321048 , version 2 (11-04-2011)



Matthieu Guillaumin, Thomas Mensink, Jakob Verbeek, Cordelia Schmid. Automatic Face Naming with Caption-based Supervision. CVPR 2008 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2008, Anchorage, United States. pp.1-8, ⟨10.1109/CVPR.2008.4587603⟩. ⟨inria-00321048v2⟩
361 View
1907 Download



Gmail Facebook Twitter LinkedIn More