Phrase-Based Language Model in Statistical Machine Translation - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue International Journal of Computational Linguistics and Applications Année : 2016

Phrase-Based Language Model in Statistical Machine Translation

Résumé

As one of the most important modules in statistical machine translation (SMT), language model measures whether one translation hypothesis is more grammatically correct than other hypotheses. Currently the state-of-the-art SMT systems use standard word n-gram models, whereas the translation model is phrase-based. In this paper, the idea is to use a phrase-based language model. For that, target portion of the translation table are retrieved and used to rewrite the training corpus and to calculate a phrase n-gram language model. In this work, we perform experiments with two language models word-based (WBLM) and phrase-based (PBLM). The different SMT are trained with three optimization algorithms MERT, MIRA and PRO. Thus, the PBLM systems are compared to the baseline system in terms of BLUE and TER. The experimental results show that the use of a phrase-based language model in SMT can improve results and is especially able to reduce the error rate.
Fichier principal
Vignette du fichier
CICLING2016.pdf (206.82 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01336485 , version 1 (23-06-2016)

Identifiants

  • HAL Id : hal-01336485 , version 1

Citer

Achraf Ben Romdhane, Salma Jamoussi, Abdelmajid Ben Hamadou, Kamel Smaïli. Phrase-Based Language Model in Statistical Machine Translation. International Journal of Computational Linguistics and Applications, 2016. ⟨hal-01336485⟩
220 Consultations
109 Téléchargements

Partager

Gmail Facebook X LinkedIn More