Establishing Good Benchmarks and Baselines for Face Recognition

Abstract : Progress in face recognition relies critically on the creation of test sets against which the performance of various approaches can be evaluated. A good set must capture the essential elements of what makes the problem hard, while conforming to practical scale limitations. However, these goals are often deceptively difficult to achieve. In the related area of object recognition, Pinto et al. [2] demonstrated the potential dangers of using a large, uncontrolled natural image set, showing that an extremely rudimentary vision system (inspired by the early stages of visual processing in the brain) was able to perform on par with many state-of-the-art vision systems on the popular Caltech101 object set [3]. At the same time, this same rudimentary system was easily defeated by an ostensibly "simpler" synthetic recognition test designed to better span the range of real world variation in object pose, position, scale, etc. These results suggested that image sets that look "natural" to human observers may nonetheless fail to properly embody the problem of interest, and that care must be taken to establish baselines against which performance can be judged. Here, we repeat this approach for the "Labeled Faces in the Wild" (LFW) dataset [1], and for a collection of standard face recognition tests. The goal of the present work is not to compete in the LFW challenge, per se, but to provide a baseline against which the performance of other systems can be judged. In particular, we found that our rudimentary "baseline" vision system was able to achieve ~68% correct performance on the LFW challenge, substantially higher than a pure "chance" baseline. We argue that this value might serve as a more useful baseline against which to evaluate absolute performance and argue that the LFW set, while perhaps not perfect, represents an improvement over other standard face sets.
Type de document :
Communication dans un congrès
Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition, Oct 2008, Marseille, France. 2008
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger
Contributeur : Peter Sturm <>
Soumis le : dimanche 5 octobre 2008 - 13:08:08
Dernière modification le : lundi 6 octobre 2008 - 09:36:09
Document(s) archivé(s) le : lundi 8 octobre 2012 - 13:57:05


Fichiers produits par l'(les) auteur(s)


  • HAL Id : inria-00326732, version 1



Nicolas Pinto, James J. Dicarlo, David D. Cox. Establishing Good Benchmarks and Baselines for Face Recognition. Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition, Oct 2008, Marseille, France. 2008. 〈inria-00326732〉



Consultations de la notice


Téléchargements de fichiers