Motion planning for robot audition

Quan V. Nguyen 1, 2 Francis Colas 1 Emmanuel Vincent 3 François Charpillet 1
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
2 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
3 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Robot audition refers to a range of hearing capabilities which help robots explore and understand their environment. Among them, sound source localization is the problem of estimating the location of a sound source given measurements of its angle of arrival with respect to a microphone array mounted on the robot. In addition, robot motion can help quickly solve the front-back ambiguity existing in a linear microphone array. In this article, we focus on the problem of exploiting robot motion to improve the estimation of the location of an intermittent and possibly moving source in a noisy and reverberant environment. We first propose a robust extended mixture Kalman filtering framework for jointly estimating the source location and its activity over time. Building on this framework, we then propose a long-term robot motion planning algorithm based on Monte Carlo tree search to find an optimal robot trajectory according to two alternative criteria: the Shannon entropy or the standard deviation of the estimated belief on the source location. These criteria are integrated over time using a discount factor. Experimental results show the robustness of the proposed estimation framework to false angle of arrival measurements within ±20◦ and 10% false source activity detection rate. The proposed robot motion planning technique achieves an average localization error 48.7% smaller than a one-step-ahead method. In addition, we compare the correlation between the estimation error and the two criteria, and investigate the effect of the discount factor on the performance of the proposed motion planning algorithm.
Document type :
Journal articles
Complete list of metadatas

Cited literature [71 references]  Display  Hide  Download

https://hal.inria.fr/hal-02188342
Contributor : Emmanuel Vincent <>
Submitted on : Monday, July 22, 2019 - 10:53:52 PM
Last modification on : Thursday, July 25, 2019 - 5:00:37 PM

File

AR_journal_nguyen.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02188342, version 1

Citation

Quan V. Nguyen, Francis Colas, Emmanuel Vincent, François Charpillet. Motion planning for robot audition. Autonomous Robots, Springer Verlag, In press. ⟨hal-02188342⟩

Share

Metrics

Record views

157

Files downloads

202