Face recognition from caption-based supervision - Archive ouverte HAL Access content directly
Journal Articles International Journal of Computer Vision Year : 2012

Face recognition from caption-based supervision

(1) , (1, 2) , (1) , (1)
1
2

Abstract

In this paper, we present methods for face recognition using a collection of images with captions. We consider two tasks: retrieving all faces of a particular person in a data set, and establishing the correct association between the names in the captions and the faces in the images. This is challenging because of the very large appearance variation in the images, as well as the potential mismatch between images and their captions. For both tasks, we compare generative and discriminative probabilistic models, as well as methods that maximize subgraph densities in similarity graphs. We extend them by considering different metric learning techniques to obtain appropriate face representations that reduce intra person variability and increase inter person separation. For the retrieval task, we also study the benefit of query expansion. To evaluate performance, we use a new fully labeled data set of 31147 faces which extends the recent LFW data set. We present extensive experimental results which show that metric learning significantly improves the performance of all approaches on both tasks.
Fichier principal
Vignette du fichier
paper.pdf (1.77 Mo) Télécharger le fichier
Vignette du fichier
Screenshot.png (266.28 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Loading...

Dates and versions

inria-00585834 , version 1 (14-04-2011)

Identifiers

Cite

Matthieu Guillaumin, Thomas Mensink, Jakob Verbeek, Cordelia Schmid. Face recognition from caption-based supervision. International Journal of Computer Vision, 2012, 96 (1), pp.64-82. ⟨10.1007/s11263-011-0447-x⟩. ⟨inria-00585834⟩
1096 View
1596 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More