Neural Network Based Reinforcement Learning for Audio-Visual Gaze Control in Human-Robot Interaction - Archive ouverte HAL Access content directly
Journal Articles Pattern Recognition Letters Year : 2019

Neural Network Based Reinforcement Learning for Audio-Visual Gaze Control in Human-Robot Interaction

(1) , (1) , (1) , (1)
1

Abstract

This paper introduces a novel neural network-based reinforcement learning approach for robot gaze control. Our approach enables a robot to learn and to adapt its gaze control strategy for human-robot interaction neither with the use of external sensors nor with human supervision. The robot learns to focus its attention onto groups of people from its own audio-visual experiences, independently of the number of people, of their positions and of their physical appearances. In particular, we use a recurrent neural network architecture in combination with Q-learning to find an optimal action-selection policy; we pre-train the network using a simulated environment that mimics realistic scenarios that involve speaking/silent participants, thus avoiding the need of tedious sessions of a robot interacting with people. Our experimental evaluation suggests that the proposed method is robust in terms of parameter configuration, i.e. the selection of the parameter values employed by the method do not have a decisive impact on the performance. The best results are obtained when both audio and visual information is jointly used. Experiments with the Nao robot indicate that our framework is a step forward towards the autonomous learning of a socially acceptable gaze behavior.
Vignette du fichier
example-RLGaze.png (245.92 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
Lathuiliere-arxiv-v2.pdf (4.17 Mo) Télécharger le fichier
Vignette du fichier
example-RLGaze.jpg (23.62 Ko) Télécharger le fichier
Vignette du fichier
slides.pdf (11.71 Mo) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01643775 , version 1 (21-11-2017)
hal-01643775 , version 2 (25-04-2018)

Identifiers

Cite

Stéphane Lathuilière, Benoît Massé, Pablo Mesejo, Radu Horaud. Neural Network Based Reinforcement Learning for Audio-Visual Gaze Control in Human-Robot Interaction. Pattern Recognition Letters, 2019, 118, pp.61-71. ⟨10.1016/j.patrec.2018.05.023⟩. ⟨hal-01643775v2⟩
673 View
353 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More