CRNN-based multiple DoA estimation using Ambisonics acoustic intensity features - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2018

CRNN-based multiple DoA estimation using Ambisonics acoustic intensity features

Résumé

Localizing audio sources is challenging in real reverberant environments, especially when several sources are active. We propose to use a neural network built from stacked convolutional and recurrent layers in order to estimate the direction of arrival of multiple sources from a first-order Ambisonics recording. It returns the directions of arrival (over a discrete grid) of a known number of sources. We propose to use features derived from the acoustic intensity vector as inputs. We analyze the behavior of the neural network by means of a visualization technique called layerwise relevance propagation. This analysis highlights which parts of the input signal are relevant in a given situation. We also conduct experiments to evaluate the performance of our system in various environments, from simulated rooms to real recordings, with one or two speech sources. The results show that the proposed features significantly improve performances with respect to raw Ambisonics inputs.
Fichier principal
Vignette du fichier
perotin (1).pdf (5.5 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01839883 , version 1 (16-07-2018)
hal-01839883 , version 2 (26-02-2019)

Identifiants

  • HAL Id : hal-01839883 , version 1

Citer

Lauréline Perotin, Romain Serizel, Emmanuel Vincent, Alexandre Guérin. CRNN-based multiple DoA estimation using Ambisonics acoustic intensity features. 2018. ⟨hal-01839883v1⟩
514 Consultations
1661 Téléchargements

Partager

Gmail Facebook X LinkedIn More