Audio-Motor Integration for Robot Audition - Archive ouverte HAL Access content directly
Book Sections Year : 2018

Audio-Motor Integration for Robot Audition

(1) , (2) , (2)


In the context of robotics, audio signal processing in the wild amounts to dealing with sounds recorded by a system that moves and whose actuators produce noise. This creates additional challenges in sound source localization, signal enhancement and recognition. But the speci-ficity of such platforms also brings interesting opportunities: can information about the robot actuators' states be meaningfully integrated in the audio processing pipeline to improve performance and efficiency? While robot audition grew to become an established field, methods that explicitly use motor-state information as a complementary modality to audio are scarcer. This chapter proposes a unified view of this endeavour, referred to as audio-motor integration. A literature review and two learning-based methods for audio-motor integration in robot audition are presented, with application to single-microphone sound source localization and ego-noise reduction on real data.
Fichier principal
Vignette du fichier
Book.pdf (1.04 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01929388 , version 1 (21-11-2018)


  • HAL Id : hal-01929388 , version 1


Antoine Deleforge, Alexander Schmidt, Walter Kellermann. Audio-Motor Integration for Robot Audition. Multimodal Behavior Analysis in the Wild, Academic Press, pp.1-27, 2018. ⟨hal-01929388⟩
81 View
321 Download


Gmail Facebook Twitter LinkedIn More