A Cascaded Multiple-Speaker Localization and Tracking System

Xiaofei Li 1 Yutong Ban 1 Laurent Girin 2, 1 Xavier Alameda-Pineda 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
Abstract : This paper presents an online multiple-speaker localization and tracking method, as the INRIA-Perception contribution to the LOCATA Challenge 2018. First, the recursive least-square method is used to adaptively estimate the direct-path relative transfer function as an interchannel localization feature. The feature is assumed to associate with a single speaker at each time-frequency bin. Second, a complex Gaussian mixture model (CGMM) is used as a generative model of the features. The weight of each CGMM component represents the probability that this component corresponds to an active speaker, and is adaptively estimated with an online optimization algorithm. Finally, taking the CGMM component weights as observations, a Bayesian multiple-speaker tracking method based on the variational expectation maximization algorithm is used. The tracker accounts for the variation of active speakers and the localization miss measurements, by introducing speaker birth and sleeping processes. The experiments carried out on the development dataset of the challenge are reported.
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download

https://hal.inria.fr/hal-01957137
Contributor : Team Perception <>
Submitted on : Monday, December 17, 2018 - 10:30:50 AM
Last modification on : Thursday, February 7, 2019 - 3:36:26 PM
Long-term archiving on : Monday, March 18, 2019 - 2:36:09 PM

File

1812.04417.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01957137, version 1

Citation

Xiaofei Li, Yutong Ban, Laurent Girin, Xavier Alameda-Pineda, Radu Horaud. A Cascaded Multiple-Speaker Localization and Tracking System. Proceedings of the LOCATA Challenge Workshop - a satellite event of IWAENC 2018, Sep 2018, Tokyo, Japan. pp.1-5. ⟨hal-01957137⟩

Share

Metrics

Record views

144

Files downloads

95