Evaluation of Topic Identification Methods on Arabic Corpora

Mourad Abbas 1 Kamel Smaili 2, 3 Daoud Berkani 4
2 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
3 SMarT - Statistical Machine Translation and Speech Modelization and Text
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Topic Identification is one of the important keys for the success of many applications. Indeed, there are few works in this field concerning Arabic language because of lack of standard corpora. In this study, we will provide directly comparable results of six text categorization methods on a new Arabic corpus Alwatan-2004. Hence, Topic Unigram Language Model (TULM), Term Frequency/Inverse Document Frequency (TFIDF), Neural Network, SVM, M-SVM and TR have been experimented, and showed that TR-Classifier is the most efficient among the set of classifiers, nevertheless, only binary SVM outperformed it thanks to its characteristics. Moreover, we should note that the size of Alwatan-2004 corpus used to achieve our experiments is considered the most important compared to any other Arabic corpus which had been used for topic identification experiments until now. In addition, we aim through using small sizes of vocabularies to reduce the time of computation. This is important for adaptive language modeling, particularly Topic Adaptation, which is required in real time applications such as speech recognition and machine translation systems. Our experiments indicate that the results are better than other works dealing with Arabic text categorization.
Type de document :
Article dans une revue
Journal of Digital Information Management, Digital Information Research Foundation, 2011, 9 (5), pp.8 double column
Liste complète des métadonnées

https://hal.inria.fr/hal-01586544
Contributeur : Kamel Smaïli <>
Soumis le : mercredi 13 septembre 2017 - 01:30:23
Dernière modification le : jeudi 11 janvier 2018 - 06:27:18

Identifiants

  • HAL Id : hal-01586544, version 1

Collections

Citation

Mourad Abbas, Kamel Smaili, Daoud Berkani. Evaluation of Topic Identification Methods on Arabic Corpora. Journal of Digital Information Management, Digital Information Research Foundation, 2011, 9 (5), pp.8 double column. 〈hal-01586544〉

Partager

Métriques

Consultations de la notice

99