HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

A robust method to count, locate and separate audio sources in a multichannel underdetermined mixture

Simon Arberet 1 Rémi Gribonval 1 Frédéric Bimbot 1
1 METISS - Speech and sound data modeling and processing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : We propose a method to count and estimate the mixing directions and the sources in an underdetermined multichannel mixture. Like DUET-type methods, the approach is based on the hypothesis that the sources have time-frequency representations with limited overlap. However, instead of assuming essentially disjoint representations, we only assume that, in the neighbourhood of some time-frequency points, only one source contributes to the mixture: such time-frequency points can provide robust local estimates of the corresponding source direction. At the core of our contribution is a local confidence measure --inspired by the work of Deville on TIFROM-- which detect the time-frequency regions where such a robust information is available. A clustering algorithm called DEMIX is proposed to merge the information from all time-frequency regions according to their confidence level. Two variants are proposed to treat instantaneous and anechoic mixtures. In the latter case, to overcome the intrinsic ambiguities of phase unwrapping as met with DUET, we propose a technique similar to GCC-PHAT to estimate time-delay parameters from phase differences between time-frequency representations of different channels. The resulting method is shown to be robust in conditions where all DUET-like comparable methods fail: a) when time-delays largely exceed one sample; b) when the source directions are very close. As an example, experiments show that, in more than 65% of the tested stereophonic mixtures of six speech sources, DEMIX-Anechoic correctly estimates the number of sources and outperforms DUET in the accuracy, providing a distance error 10 times lower.
Document type :
Complete list of metadata

Contributor : Simon Arberet Connect in order to contact the contributor
Submitted on : Monday, August 4, 2008 - 3:27:22 PM
Last modification on : Friday, February 4, 2022 - 3:23:57 AM
Long-term archiving on: : Saturday, November 26, 2016 - 1:35:14 AM


Files produced by the author(s)


  • HAL Id : inria-00305435, version 2


Simon Arberet, Rémi Gribonval, Frédéric Bimbot. A robust method to count, locate and separate audio sources in a multichannel underdetermined mixture. [Research Report] RR-6593, INRIA. 2008, pp.29. ⟨inria-00305435v2⟩



Record views


Files downloads