Skip to Main content Skip to Navigation
Journal articles

Evaluation of Topic Identification Methods on Arabic Corpora

Mourad Abbas 1 Kamel Smaili 2, 3 Daoud Berkani 4
2 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
3 SMarT - Statistical Machine Translation and Speech Modelization and Text
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Topic Identification is one of the important keys for the success of many applications. Indeed, there are few works in this field concerning Arabic language because of lack of standard corpora. In this study, we will provide directly comparable results of six text categorization methods on a new Arabic corpus Alwatan-2004. Hence, Topic Unigram Language Model (TULM), Term Frequency/Inverse Document Frequency (TFIDF), Neural Network, SVM, M-SVM and TR have been experimented, and showed that TR-Classifier is the most efficient among the set of classifiers, nevertheless, only binary SVM outperformed it thanks to its characteristics. Moreover, we should note that the size of Alwatan-2004 corpus used to achieve our experiments is considered the most important compared to any other Arabic corpus which had been used for topic identification experiments until now. In addition, we aim through using small sizes of vocabularies to reduce the time of computation. This is important for adaptive language modeling, particularly Topic Adaptation, which is required in real time applications such as speech recognition and machine translation systems. Our experiments indicate that the results are better than other works dealing with Arabic text categorization.
Document type :
Journal articles
Complete list of metadata
Contributor : Kamel Smaïli Connect in order to contact the contributor
Submitted on : Wednesday, September 13, 2017 - 1:30:23 AM
Last modification on : Saturday, October 16, 2021 - 11:26:09 AM


  • HAL Id : hal-01586544, version 1




Mourad Abbas, Kamel Smaili, Daoud Berkani. Evaluation of Topic Identification Methods on Arabic Corpora. Journal of Digital Information Management, Digital Information Research Foundation, 2011, 9 (5), pp.8 double column. ⟨hal-01586544⟩



Record views