Skip to Main content Skip to Navigation
Journal articles

Phrase-Based Language Model in Statistical Machine Translation

Abstract : As one of the most important modules in statistical machine translation (SMT), language model measures whether one translation hypothesis is more grammatically correct than other hypotheses. Currently the state-of-the-art SMT systems use standard word n-gram models, whereas the translation model is phrase-based. In this paper, the idea is to use a phrase-based language model. For that, target portion of the translation table are retrieved and used to rewrite the training corpus and to calculate a phrase n-gram language model. In this work, we perform experiments with two language models word-based (WBLM) and phrase-based (PBLM). The different SMT are trained with three optimization algorithms MERT, MIRA and PRO. Thus, the PBLM systems are compared to the baseline system in terms of BLUE and TER. The experimental results show that the use of a phrase-based language model in SMT can improve results and is especially able to reduce the error rate.
Document type :
Journal articles
Complete list of metadata

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-01336485
Contributor : Kamel Smaïli <>
Submitted on : Thursday, June 23, 2016 - 11:08:40 AM
Last modification on : Tuesday, June 23, 2020 - 12:30:04 PM

File

CICLING2016.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01336485, version 1

Collections

Citation

Achraf Ben Romdhane, Salma Jamoussi, Abdelmajid Ben Hamadou, Kamel Smaïli. Phrase-Based Language Model in Statistical Machine Translation. International Journal of Computational Linguistics and Applications, Alexander Gelbukh, 2016. ⟨hal-01336485⟩

Share

Metrics

Record views

367

Files downloads

265