Speech enhancement with LSTM recurrent neural networks and its application to noise-robust ASR

Felix Weninger 1 Hakan Erdogan 2, 3 Shinji Watanabe 2 Emmanuel Vincent 4 Jonathan Le Roux 2 John R. Hershey 2 Björn Schuller 5
1 TUM - Technische Universität München [München]
2 MERL - Mitsubishi Electric Research Laboratories
3 Sabanci University [Istanbul]
4 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
5 Imperial College London
Abstract : We evaluate some recent developments in recurrent neural network (RNN) based speech enhancement in the light of noise-robust automatic speech recognition (ASR). The proposed framework is based on Long Short-Term Memory (LSTM) RNNs which are discriminatively trained according to an optimal speech reconstruction objective. We demonstrate that LSTM speech enhancement, even when used ' na¨vely ' as front-end processing, delivers competitive results on the CHiME-2 speech recognition task. Furthermore, simple, feature-level fusion based extensions to the framework are proposed to improve the integration with the ASR back-end. These yield a best result of 13.76 % average word error rate, which is, to our knowledge, the best score to date.
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download
https://hal.inria.fr/hal-01163493
Contributor : Emmanuel Vincent <>
Submitted on : Saturday, June 13, 2015 - 10:46:45 AM
Last modification on : Saturday, March 30, 2019 - 1:26:26 AM
Long-term archiving on : Monday, September 14, 2015 - 10:05:47 AM

File

weninger_LVA15.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01163493, version 1

Collections

INRIA | UNIV-LORRAINE | GRID5000 | LORIA-NLPKD | LORIA

Citation

Felix Weninger, Hakan Erdogan, Shinji Watanabe, Emmanuel Vincent, Jonathan Le Roux, et al.. Speech enhancement with LSTM recurrent neural networks and its application to noise-robust ASR. 12th International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA), Aug 2015, Liberec, Czech Republic. ⟨hal-01163493⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

4241

Files downloads

7697

Contact


archive-ouverte@inria.fr