Skip to Main content Skip to Navigation
Journal articles

Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities

Motaz Saad 1 David Langlois 1 Kamel Smaïli 1
1 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Parallel corpora are not available for all domains and languages, but statistical methods in multilingual research domains require huge parallel/comparable corpora. Comparable corpora can be used when the parallel is not sufficient or not available for specific domains and languages. In this paper, we propose a method to extract all comparable articles from Wikipedia for multiple languages based on interlanguge links. We also extract comparable articles from Euro News website. We also present two comparability measures (CM) to compute the degree of comparability of multilingual articles. We extracted about 40K and 34K comparable articles from Wikipedia and Euro News respectively in three languages including Arabic, French, and English. Experimental results of comparability measures show that our measure can capture the comparability of multilingual corpora and allow to retrieve articles from different language concerning the same topic.
Complete list of metadatas

Cited literature [12 references]  Display  Hide  Download

https://hal.inria.fr/hal-00907442
Contributor : Motaz Saad <>
Submitted on : Monday, November 20, 2017 - 10:13:42 AM
Last modification on : Tuesday, December 18, 2018 - 4:38:02 PM
Document(s) archivé(s) le : Wednesday, February 21, 2018 - 12:31:24 PM

File

saad-comparable.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Motaz Saad, David Langlois, Kamel Smaïli. Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities. Procedia - Social and Behavioral Sciences, Elsevier, 2013, 95, pp.40-47. ⟨10.1016/j.sbspro.2013.10.620⟩. ⟨hal-00907442⟩

Share

Metrics

Record views

387

Files downloads

282