A comparative study of Topic Identification on Newspaper and E-mail

Brigitte Bigi 1 Armelle Brun 1 Jean-Paul Haton 1 Kamel Smaïli 1 Imed Zitouni 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : This paper presents several statistical methods for topic identification on two kinds of textual data: newspaper articles and e-mails. Five methods are tested on these two corpora: topic unigrams, cache model, TFIDF classifier, topic perplexity, and weighted model. Our work aims to study these methods by confronting them to very different data. This study is very fruitful for our research. Statistical topic identification methods depend not only on a corpus, but also on its type. One of the methods achieves a topic identification of 80 % on a general newspaper corpus but does not exceed 30 % on e-mail corpus. Another method gives the best result on e-mails, but has not the same behavior on a newspaper corpus. We also show in this paper that almost all our methods achieve good results in retrieving the first two manually annotated labels.
Mots-clés : identification thématique topic identification language model modèles de langages e-mail
Type de document :
Communication dans un congrès
Proceedings of the 8th International Symposium on String Processing and Information Retrieval - SPIRE'01, 2001, Laguna de San Rafael, Chili, pp.238-241, 2001
Liste complète des métadonnées

Littérature citée [9 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/inria-00107535
Contributeur : Publications Loria <>
Soumis le : jeudi 19 octobre 2006 - 09:00:22
Dernière modification le : jeudi 11 janvier 2018 - 06:19:55
Document(s) archivé(s) le : mercredi 29 mars 2017 - 12:58:24

Fichier

A01-R-341.pdf

Identifiants

  • HAL Id : inria-00107535, version 1

Collections

INRIA | LORIA | UNIV-LORRAINE

Citation

Brigitte Bigi, Armelle Brun, Jean-Paul Haton, Kamel Smaïli, Imed Zitouni. A comparative study of Topic Identification on Newspaper and E-mail. Proceedings of the 8th International Symposium on String Processing and Information Retrieval - SPIRE'01, 2001, Laguna de San Rafael, Chili, pp.238-241, 2001. 〈inria-00107535〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

359

Téléchargements de fichiers

126

Contact


archive-ouverte@inria.fr