An Automated Method for Human Face Modeling and Relighting with Application to Face Recognition

Abstract : In this paper, we present a novel method for human face modeling and its application to face relighting and recognition. An annotated face model is fitted onto the raw 3D data using a subdivision-based deformable model framework. The fitted face model is subsequently converted to a geometry image representation. This results in regularly sampled, registered and annotated geometry data. The albedo of the skin is retrieved by using an analytical skin reflectance model that removes the lighting (shadows, diffuse and specular) from the texture. Additional provisions are made such that if the input contains over-saturated specular highlights, an inpainting method with texture synthesis is used as a post-processing step in order to estimate the texture. The method is fully automatic and uses as input only the 3D geometry and texture data of the face, as acquired by commercial 3D scanners. No measurement or calibration of the lighting environment is required. The method's fully automatic nature and its minimum input requirements make it applicable to both computer vision applications (e.g., face recognition) and computer graphics applications (i.e., relighting, face synthesis and facial expressions transfer). Moreover, it allows the utilization of existing 3D facial databases. We present very encouraging results on a challenging dataset .
Type de document :
Communication dans un congrès
Peter Belhumeur and Katsushi Ikeuchi and Emmanuel Prados and Stefano Soatto and Peter Sturm. Proceedings of the First International Workshop on Photometric Analysis For Computer Vision - PACV 2007, Oct 2007, Rio de Janeiro, Brazil. INRIA, 8 p., 2007
Liste complète des métadonnées

Littérature citée [42 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00267794
Contributeur : Inria Rhône-Alpes Documentation <>
Soumis le : vendredi 28 mars 2008 - 14:13:57
Dernière modification le : vendredi 28 mars 2008 - 14:36:23
Document(s) archivé(s) le : jeudi 20 mai 2010 - 20:30:11

Fichier

p38.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00267794, version 1

Collections

Citation

George Toderici, Georgios Passalis, Theoharis Theoharis, Ioannis Kakadiaris. An Automated Method for Human Face Modeling and Relighting with Application to Face Recognition. Peter Belhumeur and Katsushi Ikeuchi and Emmanuel Prados and Stefano Soatto and Peter Sturm. Proceedings of the First International Workshop on Photometric Analysis For Computer Vision - PACV 2007, Oct 2007, Rio de Janeiro, Brazil. INRIA, 8 p., 2007. 〈inria-00267794〉

Partager

Métriques

Consultations de la notice

197

Téléchargements de fichiers

169