Skip to Main content Skip to Navigation
Conference papers

Multi-Sensors Engagement Detection with a Robot Companion in a Home Environment

Wafa Benkaouar 1 Dominique Vaufreydaz 1, *
* Corresponding author
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : Recognition of intentions is an unconscious cognitive process vital to human communication. This skill enables anticipation and increases interactive exchanges quality between humans. Within the context of engagement, i.e. intention for interaction, non-verbal signals are used to communicate this intention to the partner. In this paper, we investigated methods to detect these signals in order to allow a robot to know when it is about to be addressed. Classically, the human position and speed, the human-robot distance are used to detect the engagement. Our hypothesis is that this method is not enough in a context of a home environment. The chosen approach integrates multimodal features gathered using a robot enhanced with a Kinect. The evaluation of this new method of detection on our corpus collected in spontaneous conditions highlights its robustness and validates use of such technique in real environment. Experimental validation shows that the use of multimodal sensors gives better precision and recall than the detector using only spatial and speed features. We also demonstrate that 7 multimodal features are sufficient to provide a good engagement detection score.
Document type :
Conference papers
Complete list of metadata

Cited literature [23 references]  Display  Hide  Download
Contributor : Dominique Vaufreydaz Connect in order to contact the contributor
Submitted on : Monday, January 14, 2013 - 5:03:51 PM
Last modification on : Tuesday, October 12, 2021 - 2:38:08 PM
Long-term archiving on: : Monday, April 15, 2013 - 3:52:47 AM


Publisher files allowed on an open archive


  • HAL Id : hal-00735150, version 1



Wafa Benkaouar, Dominique Vaufreydaz. Multi-Sensors Engagement Detection with a Robot Companion in a Home Environment. Workshop on Assistance and Service robotics in a human environment at IEEE International Conference on Intelligent Robots and Systems (IROS2012), Anne Spalanzani, David Daney, Olivier Simonin, Jean-Pierre Merlet, Oct 2012, Vilamoura, Algarve, Portugal. pp.45-52. ⟨hal-00735150⟩



Les métriques sont temporairement indisponibles