Language modeling using dynamic Bayesian networks

Murat Deviren 1 Khalid Daoudi 1 Kamel Smaïli 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In this paper we propose a new approach to language modeling based on dynamic Bayesian networks. The principle idea of our approach is to find the dependence relations between variables that represent different linguistic units (word, class, concept, ...) that constitutes a language model. In the context of this paper the linguistic units that we consider are syntactic classes and words. Our approach should not be considered as a model combination technique. Rather, it is an original and coherent methodology that processes words and classes in the same model. We attempt to identify and model the dependence of words and classes on their linguistic context. Our ultimate goal is to devise an automatic mechanism that extracts the best dependence relations between a word and its context, i.e., lexical and syntactic. Preliminary results are very encouraging, in particular the model in which a word depends not only on previous word but also on syntactic classes of two previous words. This model outperforms the bi-gram model.
Document type :
Conference papers
Complete list of metadatas

Cited literature [7 references]  Display  Hide  Download

https://hal.inria.fr/inria-00107786
Contributor : Publications Loria <>
Submitted on : Thursday, October 19, 2006 - 9:09:18 AM
Last modification on : Thursday, January 11, 2018 - 6:19:55 AM
Long-term archiving on: Wednesday, March 29, 2017 - 1:25:53 PM

Identifiers

  • HAL Id : inria-00107786, version 1

Collections

Citation

Murat Deviren, Khalid Daoudi, Kamel Smaïli. Language modeling using dynamic Bayesian networks. 4th International Conference on Language Resources and Evaluation - LREC 2004, 2004, Lisbonne, Portugal. ⟨inria-00107786⟩

Share

Metrics

Record views

303

Files downloads

271