3D facial expression recognition using SIFT descriptors of automatically detected keypoints - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue The Visual Computer Année : 2011

3D facial expression recognition using SIFT descriptors of automatically detected keypoints

Résumé

Methods to recognize humans' facial expressions have been proposed mainly focusing on 2D still images and videos. In this paper, the problem of person-independent facial expression recognition is addressed using the 3D geometry information extracted from the 3D shape of the face. To this end, a completely automatic approach is proposed that relies on identifying a set of facial keypoints, computing SIFT feature descriptors of depth images of the face around sample points defined starting from the facial keypoints, and selecting the subset of features with maximum relevance. Training a Support Vector Machine (SVM) for each facial expression to be recognized, and combining them to form. a multi-class classifier, an average recognition rate of 78.43% on the BU-3DFE database has been obtained. Comparison with competitor approaches using a common experimental setting on the BU-3DFE database shows that our solution is capable of obtaining state of the art results. The same 3D face representation framework and testing database have been also used to perform. 3D facial expression retrieval (i.e., retrieve 3D scans with the same facial expression as shown by a target subject), with results proving the viability of the proposed solution.
Fichier principal
Vignette du fichier
tvcj11.pdf (1.74 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00661777 , version 1 (20-01-2012)

Identifiants

Citer

Stefano Berretti, Boulbaba Ben Amor, Mohamed Daoudi, Alberto del Bimbo. 3D facial expression recognition using SIFT descriptors of automatically detected keypoints. The Visual Computer, 2011, 27 (11), pp.1021-1036. ⟨10.1007/s00371-011-0611-x⟩. ⟨hal-00661777⟩
666 Consultations
1315 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More