Skip to Main content Skip to Navigation
New interface
Conference papers

The Cocktail Party Robot: Sound Source Separation and Localisation with an Active Binaural Head

Antoine Deleforge 1 Radu Horaud 1 
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : Robots that are capable of communicating with people in a natural way must be endowed with auditory scene analysis abilities. For example, a humanoid robot has its own on-board microphones and therefore the perceived acoustic signals contain a mix of sounds such as speech, music, electronic devices, all in the presence of attenuation and reverberations. In this paper we propose a new methodology solving for sound-source separation and localization based on a generative probabilistic model and on active binaural hearing. We show how interaural cues can be used within a mixture model specifically designed to capture the richness of the data gathered with two microphones mounted onto a robot head with a human-like head related transfer function. We show how sound-source localization can be combined with learning an audio-motor map. We describe in detail a novel EM algorithm, we analyse it, and we assess its performance with both simulated and real data.
Complete list of metadata

Cited literature [25 references]  Display  Hide  Download
Contributor : Perception team Connect in order to contact the contributor
Submitted on : Saturday, December 22, 2012 - 6:33:42 PM
Last modification on : Saturday, June 25, 2022 - 7:44:32 PM
Long-term archiving on: : Saturday, March 23, 2013 - 3:47:40 AM


Files produced by the author(s)




Antoine Deleforge, Radu Horaud. The Cocktail Party Robot: Sound Source Separation and Localisation with an Active Binaural Head. HRI 2012 - 7th ACM/IEEE International Conference on Human Robot Interaction, Mar 2012, Boston, United States. pp.431-438, ⟨10.1145/2157689.2157834⟩. ⟨hal-00768668⟩



Record views


Files downloads