Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Procedia - Social and Behavioral Sciences Année : 2013

Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities

Résumé

Parallel corpora are not available for all domains and languages, but statistical methods in multilingual research domains require huge parallel/comparable corpora. Comparable corpora can be used when the parallel is not sufficient or not available for specific domains and languages. In this paper, we propose a method to extract all comparable articles from Wikipedia for multiple languages based on interlanguge links. We also extract comparable articles from Euro News website. We also present two comparability measures (CM) to compute the degree of comparability of multilingual articles. We extracted about 40K and 34K comparable articles from Wikipedia and Euro News respectively in three languages including Arabic, French, and English. Experimental results of comparability measures show that our measure can capture the comparability of multilingual corpora and allow to retrieve articles from different language concerning the same topic.
Fichier principal
Vignette du fichier
saad-comparable.pdf (278.4 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00907442 , version 1 (20-11-2017)

Identifiants

Citer

Motaz Saad, David Langlois, Kamel Smaïli. Extracting Comparable Articles from Wikipedia and Measuring their Comparabilities. Procedia - Social and Behavioral Sciences, 2013, 95, pp.40-47. ⟨10.1016/j.sbspro.2013.10.620⟩. ⟨hal-00907442⟩
198 Consultations
160 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More