Exploiting confidence measures for missing data speech recognition

Christophe Cerisara 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Automatic speech recognition in highly non-stationary noise, for instance with a competing speaker or background music, is an extremely challenging and still unsolved problem. Missing data recognition is a robust approach that is well adapted to this kind of noise. A standard missing data technique consists in marginalizing out, from the observation likelihoods computed during decoding, the contribution of the spectro-temporal fragments that are dominated by noise. However, such an approach can hardly be applied to advanced parameterization domains that do not separate speech from noise frequencies, such as the cepstrum or ETSI AFE. We propose in the work to extend this technique to such parameterization domains, and not only to spectrographic-like front-ends as it was the case before. This is realized by masking the observations that favor erroneous decoding paths, instead of masking the features that are dominated by noise. These new missing data "masks" are now estimated based on speech recognition confidence measures, which can be considered as indicators of the reliability of decoding paths. A first version of this robust algorithm is evaluated on the French broadcast news ESTER corpus.
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/inria-00330726
Contributor : Christophe Cerisara <>
Submitted on : Wednesday, December 10, 2008 - 10:45:24 AM
Last modification on : Tuesday, September 24, 2019 - 4:00:14 PM
Long-term archiving on : Monday, June 7, 2010 - 6:27:15 PM

File

acoustics08.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00330726, version 1

Collections

Citation

Christophe Cerisara. Exploiting confidence measures for missing data speech recognition. Proceedings on Acoustics'08, Jul 2008, Paris, France. ⟨inria-00330726⟩

Share

Metrics

Record views

257

Files downloads

254