Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities - Archive ouverte HAL Access content directly
Journal Articles Procedia - Social and Behavioral Sciences Year : 2013

Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities

(1) , (1) , (1)
1

Abstract

Parallel corpora are not available for all domains and languages, but statistical methods in multilingual research domains require huge parallel/comparable corpora. Comparable corpora can be used when the parallel is not sufficient or not available for specific domains and languages. In this paper, we propose a method to extract all comparable articles from Wikipedia for multiple languages based on interlanguge links. We also extract comparable articles from Euro News website. We also present two comparability measures (CM) to compute the degree of comparability of multilingual articles. We extracted about 40K and 34K comparable articles from Wikipedia and Euro News respectively in three languages including Arabic, French, and English. Experimental results of comparability measures show that our measure can capture the comparability of multilingual corpora and allow to retrieve articles from different language concerning the same topic.
Fichier principal
Vignette du fichier
saad-comparable.pdf (278.4 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00907442 , version 1 (20-11-2017)

Identifiers

Cite

Motaz Saad, David Langlois, Kamel Smaïli. Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities. Procedia - Social and Behavioral Sciences, 2013, 95, pp.40-47. ⟨10.1016/j.sbspro.2013.10.620⟩. ⟨hal-00907442⟩
189 View
138 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More