Skip to Main content Skip to Navigation
Conference papers

Language modeling using dynamic Bayesian networks

Murat Deviren 1 Khalid Daoudi 1 Kamel Smaïli 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In this paper we propose a new approach to language modeling based on dynamic Bayesian networks. The principle idea of our approach is to find the dependence relations between variables that represent different linguistic units (word, class, concept, ...) that constitutes a language model. In the context of this paper the linguistic units that we consider are syntactic classes and words. Our approach should not be considered as a model combination technique. Rather, it is an original and coherent methodology that processes words and classes in the same model. We attempt to identify and model the dependence of words and classes on their linguistic context. Our ultimate goal is to devise an automatic mechanism that extracts the best dependence relations between a word and its context, i.e., lexical and syntactic. Preliminary results are very encouraging, in particular the model in which a word depends not only on previous word but also on syntactic classes of two previous words. This model outperforms the bi-gram model.
Document type :
Conference papers
Complete list of metadata

Cited literature [7 references]  Display  Hide  Download
Contributor : Publications Loria Connect in order to contact the contributor
Submitted on : Thursday, October 19, 2006 - 9:09:18 AM
Last modification on : Friday, February 26, 2021 - 3:28:05 PM
Long-term archiving on: : Wednesday, March 29, 2017 - 1:25:53 PM


  • HAL Id : inria-00107786, version 1



Murat Deviren, Khalid Daoudi, Kamel Smaïli. Language modeling using dynamic Bayesian networks. 4th International Conference on Language Resources and Evaluation - LREC 2004, 2004, Lisbonne, Portugal. ⟨inria-00107786⟩



Record views


Files downloads