Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction - Archive ouverte HAL Access content directly
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2018

Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction

(1) , (1) , (1)
1

Abstract

The visual focus of attention (VFOA) has been recognized as a prominent conversational cue. We are interested in estimating and tracking the VFOAs associated with multi-party social interactions. We note that in this type of situations the participants either look at each other or at an object of interest; therefore their eyes are not always visible. Consequently both gaze and VFOA estimation cannot be based on eye detection and tracking. We propose a method that exploits the correlation between eye gaze and head movements. Both VFOA and gaze are modeled as latent variables in a Bayesian switching state-space model (also referred switching Kalman filter). The proposed formulation leads to a tractable learning method and to an efficient online inference procedure that simultaneously tracks gaze and visual focus. The method is tested and benchmarked using two publicly available datasets, Vernissage and LAEO, that contain typical multi-party human-robot and human-human interactions.
Vignette du fichier
teaser.png (349.19 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
VFOA (1).pdf (8.9 Mo) Télécharger le fichier
Vignette du fichier
teaser.jpg (34.27 Ko) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01511414 , version 1 (21-11-2017)
hal-01511414 , version 2 (10-12-2017)

Identifiers

Cite

Benoît Massé, Silèye Ba, Radu Horaud. Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40 (11), pp.2711 - 2724. ⟨10.1109/TPAMI.2017.2782819⟩. ⟨hal-01511414v2⟩
623 View
216 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More