Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Multichannel Speech Separation and Enhancement Using the Convolutive Transfer Function

Xiaofei Li 1 Laurent Girin 2, 1 Sharon Gannot 3 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, LJK - Laboratoire Jean Kuntzmann
Abstract : This paper addresses the problem of audio source recovery from multichannel noisy convolutive mixture for source separation and speech enhancement, assuming known mixing filters. We propose to conduct the source recovery in the short-time Fourier transform domain, and based on the convolutive transfer function (CTF) approximation. Compared to the time domain filters, CTF has much less taps, and thus less near-common zeros among channels and less computational complexity. This work proposes three source recovery methods, i) the multichannel inverse filtering method, i.e. multiple input/output inverse theorem (MINT), is exploited in the CTF domain, and for the multisource case, ii) a beamforming-like multichannel inverse filtering method is proposed appling the single source MINT and power minimization, which is suitable for the case that not the CTFs of all the sources are known, iii) a constrained Lasso method. The sources are recovered by minimizing their $\ell_1$-norm to impose the spectral sparsity, with the constraint that the $\ell_2$-norm fitting cost between the microphone signals and the mixture model involving the unknown source signals is less than a tolerance. The noise can be reduced by setting the tolerance to the noise power. Experiments under various acoustic conditions are conducted to evaluate the three proposed methods. The comparison among them and with the baseline methods are presented.
Complete list of metadata

Cited literature [48 references]  Display  Hide  Download
Contributor : Team Perception <>
Submitted on : Monday, February 26, 2018 - 11:15:19 AM
Last modification on : Thursday, November 19, 2020 - 1:02:25 PM


Files produced by the author(s)


  • HAL Id : hal-01645749, version 2
  • ARXIV : 1711.07911


Xiaofei Li, Laurent Girin, Sharon Gannot, Radu Horaud. Multichannel Speech Separation and Enhancement Using the Convolutive Transfer Function. 2018. ⟨hal-01645749v2⟩



Record views


Files downloads