Multi-Sensors Engagement Detection with a Robot Companion in a Home Environment

Wafa Benkaouar 1 Dominique Vaufreydaz 1, *
* Corresponding author
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : Recognition of intentions is an unconscious cognitive process vital to human communication. This skill enables anticipation and increases interactive exchanges quality between humans. Within the context of engagement, i.e. intention for interaction, non-verbal signals are used to communicate this intention to the partner. In this paper, we investigated methods to detect these signals in order to allow a robot to know when it is about to be addressed. Classically, the human position and speed, the human-robot distance are used to detect the engagement. Our hypothesis is that this method is not enough in a context of a home environment. The chosen approach integrates multimodal features gathered using a robot enhanced with a Kinect. The evaluation of this new method of detection on our corpus collected in spontaneous conditions highlights its robustness and validates use of such technique in real environment. Experimental validation shows that the use of multimodal sensors gives better precision and recall than the detector using only spatial and speed features. We also demonstrate that 7 multimodal features are sufficient to provide a good engagement detection score.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [23 references]  Display  Hide  Download

https://hal.inria.fr/hal-00735150
Contributor : Dominique Vaufreydaz <>
Submitted on : Monday, January 14, 2013 - 5:03:51 PM
Last modification on : Thursday, January 11, 2018 - 6:22:03 AM
Document(s) archivé(s) le : Monday, April 15, 2013 - 3:52:47 AM

File

Benkaouar-Vaufreydaz_WS-IROS20...
Publisher files allowed on an open archive

Identifiers

  • HAL Id : hal-00735150, version 1

Collections

Citation

Wafa Benkaouar, Dominique Vaufreydaz. Multi-Sensors Engagement Detection with a Robot Companion in a Home Environment. Workshop on Assistance and Service robotics in a human environment at IEEE International Conference on Intelligent Robots and Systems (IROS2012), Anne Spalanzani, David Daney, Olivier Simonin, Jean-Pierre Merlet, Oct 2012, Vilamoura, Algarve, Portugal. pp.45-52. ⟨hal-00735150⟩

Share

Metrics

Record views

625

Files downloads

428