A new language model based on possibility theory

Abstract : Language modeling is a very important step in several NLP applications. Most of the current language models are based on probabilistic methods. In this paper, we propose a new language modeling approach based on the possibility theory. Our goal is to suggest a method for estimating the possibility of a word-sequence and to test this new approach in a machine translation system.We propose a word-sequence possibilistic measure, which can be estimated from a corpus. We proceeded in two ways: first, we checked the behaviour of the new approach compared with the existing work. Second, we compared the new language model with the probabilistic one used in statistical MT systems. The results, in terms of the METEOR metric, show that the possibilistic-language model is better than the probabilistic one. However, in terms of BLEU and TER scores, the probabilistic model remains better.
Type de document :
Chapitre d'ouvrage
Springer LNCS series, Lecture Notes in Computer Science., 2016
Liste complète des métadonnées

Littérature citée [22 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01336535
Contributeur : Kamel Smaïli <>
Soumis le : jeudi 23 juin 2016 - 11:45:37
Dernière modification le : vendredi 11 mai 2018 - 15:04:02

Fichier

paper_57.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01336535, version 1

Collections

Citation

Mohamed-Amine Menacer, Abdelfetah Boumerdas, Chahnaz Zakaria, Kamel Smaili. A new language model based on possibility theory. Springer LNCS series, Lecture Notes in Computer Science., 2016. 〈hal-01336535〉

Partager

Métriques

Consultations de la notice

282

Téléchargements de fichiers

29