Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction

Benoît Massé 1 Silèye Ba 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : The visual focus of attention (VFOA) has been recognized as a prominent conversational cue. We are interested in estimating and tracking the VFOAs associated with multi-party social interactions. We note that in this type of situations the participants either look at each other or at an object of interest; therefore their eyes are not always visible. Consequently both gaze and VFOA estimation cannot be based on eye detection and tracking. We propose a method that exploits the correlation between eye gaze and head movements. Both VFOA and gaze are modeled as latent variables in a Bayesian switching state-space model (also referred switching Kalman filter). The proposed formulation leads to a tractable learning method and to an efficient online inference procedure that simultaneously tracks gaze and visual focus. The method is tested and benchmarked using two publicly available datasets, Vernissage and LAEO, that contain typical multi-party human-robot and human-human interactions.
Keywords : eye gaze human-robot interaction switching Kalman filter head pose visual focus of attention dynamic Bayesian model multi-party interaction
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2018, 40 (11), pp.2711 - 2724. 〈10.1109/TPAMI.2017.2782819〉
Liste complète des métadonnées

Littérature citée [41 références]  Voir  Masquer  Télécharger

teaser.png
teaser.png
https://hal.inria.fr/hal-01511414
Contributeur : Team Perception <>
Soumis le : dimanche 10 décembre 2017 - 15:06:08
Dernière modification le : vendredi 5 octobre 2018 - 01:13:37

Fichiers

VFOA (1).pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

UGA | LJK | INRIA | LJK_GI | LJK_GI_PERCEPTION

Citation

Benoît Massé, Silèye Ba, Radu Horaud. Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2018, 40 (11), pp.2711 - 2724. 〈10.1109/TPAMI.2017.2782819〉. 〈hal-01511414v2〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

370

Téléchargements de fichiers

133

Contact


archive-ouverte@inria.fr