Variable-Length Class Sequences Based on a Hierarchical Approach: MCnv

Imed Zitouni 1 Kamel Smaïli 1 Jean-Paul Haton 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In this paper, we describe a new language model based on dependent word sequences organized in multi-level hierarchy. We call this model MCnv, where n is the maximum number of words in a sequence and $\nu$ is the maximum number of levels. The originality of this model is its capability to take into account dependent variable-length sequences for very large vocabulary. In order to discover the variable-length sequences and to build the hierarchy, we use a set of 233 syntactic classes extracted from the eight French elementary grammatical classes. The MCnv model learns hierarchical word patterns and uses them to reevaluate and filter the n-best utterance hypotheses outputed by our speech recognizer MAUD. The model have been trained on a corpus (LeM) of 43 million of words extracted from ``Le Monde'' a French newspapers and uses a vocabulary of 20000 words. Tests have been conducted on 300 sentences. Results achieved 17% decrease in perplexity compared to an interpolated class trigram model. Rescoring the original n-best hypotheses results also in an improvement of 5% in accuracy.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/inria-00099045
Contributor : Publications Loria <>
Submitted on : Tuesday, September 26, 2006 - 8:47:52 AM
Last modification on : Thursday, January 11, 2018 - 6:19:57 AM
Long-term archiving on: Wednesday, March 29, 2017 - 12:37:38 PM

Identifiers

  • HAL Id : inria-00099045, version 1

Collections

Citation

Imed Zitouni, Kamel Smaïli, Jean-Paul Haton. Variable-Length Class Sequences Based on a Hierarchical Approach: MCnv. 4th Word Multiconference on Systemics, Cybertinics & Informatics, 2000, Orlando, USA, 6 p. ⟨inria-00099045⟩

Share

Metrics

Record views

186

Files downloads

67