Starting engagement detection towards a companion robot using multimodal features

Dominique Vaufreydaz 1 Wafa Johal 2 Claudine Combe 1
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : Recognition of intentions is a subconscious cognitive process vital to human communication. This skill enables anticipation and increases the quality of interactions between humans. Within the context of engagement, non-verbal signals are used to communicate the intention of starting the interaction with a partner. In this paper, we investigated methods to detect these signals in order to allow a robot to know when it is about to be addressed. Originality of our approach resides in taking inspiration from social and cognitive sciences to perform our perception task. We investigate meaningful features, i.e. human readable features, and elicit which of these are important for recognizing someone's intention of starting an interaction. Classically, spatial information like the human position and speed, the human-robot distance are used to detect the engagement. Our approach integrates multimodal features gathered using a companion robot equipped with a Kinect. The evaluation on our corpus collected in spontaneous conditions highlights its robustness and validates the use of such a technique in a real environment. Experimental validation shows that multimodal features set gives better precision and recall than using only spatial and speed features. We also demonstrate that 7 selected features are sufficient to provide a good starting engagement detection score. In our last investigation, we show that among our full 99 features set, the space reduction is not a solved task. This result opens new researches perspectives on multimodal engagement detection.
Type de document :
Article dans une revue
Robotics and Autonomous Systems, Elsevier, 2015, Robotics and Autonomous Systems, pp.25. 〈10.1016/j.robot.2015.01.004〉
Liste complète des métadonnées

Littérature citée [50 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01122396
Contributeur : Dominique Vaufreydaz <>
Soumis le : jeudi 12 mars 2015 - 13:57:04
Dernière modification le : jeudi 11 janvier 2018 - 06:22:03
Document(s) archivé(s) le : samedi 12 septembre 2015 - 23:01:20

Fichiers

VaufreydazEtAl2015.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Dominique Vaufreydaz, Wafa Johal, Claudine Combe. Starting engagement detection towards a companion robot using multimodal features. Robotics and Autonomous Systems, Elsevier, 2015, Robotics and Autonomous Systems, pp.25. 〈10.1016/j.robot.2015.01.004〉. 〈hal-01122396〉

Partager

Métriques

Consultations de la notice

466

Téléchargements de fichiers

475