Simultaneous Estimation of Gaze Direction and Visual Focus of Attention for Multi-Person-to-Robot Interaction

Benoit Massé 1 Silèye Ba 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We address the problem of estimating the visual focus of attention (VFOA), e.g. who is looking at whom? This is of particular interest in human-robot interactive scenarios, e.g. when the task requires to identify targets of interest over time. The paper makes the following contributions. We propose a Bayesian temporal model that connects VFOA to gaze direction and to head pose. Model inference is then cast into a switching Kalman filter formulation, which makes it tractable. The model parameters are estimated via training based on manual annotations. The method is tested and benchmarked using a publicly available dataset. We show that both the gaze and the VFOA of several persons can be reliably and simultaneously estimated over time from observed head poses as well as from people and object locations. On average , our method compares favorably with two other methods.
Type de document :
Communication dans un congrès
International Conference on Multimedia and Expo, Jul 2016, Seattle, United States. pp.1-6, 2016, 〈http://ieeexplore.ieee.org/document/7552986/〉. 〈10.1109/ICME.2016.7552986〉
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-01301766
Contributeur : Team Perception <>
Soumis le : mardi 12 avril 2016 - 18:20:56
Dernière modification le : mercredi 11 avril 2018 - 01:59:36
Document(s) archivé(s) le : mardi 15 novembre 2016 - 02:08:30

Fichiers

camera_ready.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Benoit Massé, Silèye Ba, Radu Horaud. Simultaneous Estimation of Gaze Direction and Visual Focus of Attention for Multi-Person-to-Robot Interaction. International Conference on Multimedia and Expo, Jul 2016, Seattle, United States. pp.1-6, 2016, 〈http://ieeexplore.ieee.org/document/7552986/〉. 〈10.1109/ICME.2016.7552986〉. 〈hal-01301766〉

Partager

Métriques

Consultations de la notice

646

Téléchargements de fichiers

343