Accounting for Room Acoustics in Audio-Visual Multi-Speaker Tracking

Yutong Ban 1 Xiaofei Li 1 Xavier Alameda-Pineda 1 Laurent Girin 2, 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
Abstract : Multiple-speaker tracking is a crucial task for many applications. In real-world scenarios, exploiting the complementarity between auditory and visual data enables to track people outside the visual field of view. However, practical methods must be robust to changes in acoustic conditions, e.g. reverberation. We investigate how to combine state-of-the-art audio-source localization techniques with Bayesian multi-person tracking. Our experiments demonstrate that the performance of the proposed system is not affected by changes in the acoustic environment.
Keywords : sound-source localization multi-speaker tracking audio-visual fusion dereverberation
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [20 references]  Display  Hide  Download
https://hal.inria.fr/hal-01718114
Contributor : Team Perception <>
Submitted on : Tuesday, February 27, 2018 - 10:34:57 AM
Last modification on : Friday, March 8, 2019 - 4:30:10 PM
Document(s) archivé(s) le : Monday, May 28, 2018 - 5:05:09 PM

File

Ban-ICASSP18.pdf
Files produced by the author(s)

Identifiers

Collections

UGA | LJK | INRIA | GIPSA-CRISSP | GIPSA | GIPSA-DPC | LJK_GI | LJK_GI_PERCEPTION

Citation

Yutong Ban, Xiaofei Li, Xavier Alameda-Pineda, Laurent Girin, Radu Horaud. Accounting for Room Acoustics in Audio-Visual Multi-Speaker Tracking. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2018), Apr 2018, Calgary, Alberta, Canada. pp.6553-6557, ⟨10.1109/ICASSP.2018.8462100⟩. ⟨hal-01718114⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

506

Files downloads

327

Contact


archive-ouverte@inria.fr