A comparative study of Topic Identification on Newspaper and E-mail

Brigitte Bigi 1 Armelle Brun 1 Jean-Paul Haton 1 Kamel Smaïli 1 Imed Zitouni 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : This paper presents several statistical methods for topic identification on two kinds of textual data: newspaper articles and e-mails. Five methods are tested on these two corpora: topic unigrams, cache model, TFIDF classifier, topic perplexity, and weighted model. Our work aims to study these methods by confronting them to very different data. This study is very fruitful for our research. Statistical topic identification methods depend not only on a corpus, but also on its type. One of the methods achieves a topic identification of 80 % on a general newspaper corpus but does not exceed 30 % on e-mail corpus. Another method gives the best result on e-mails, but has not the same behavior on a newspaper corpus. We also show in this paper that almost all our methods achieve good results in retrieving the first two manually annotated labels.
Mots-clés : identification thématique topic identification language model modèles de langages e-mail
Document type :
Conference papers
Complete list of metadatas

Cited literature [9 references]  Display  Hide  Download
https://hal.inria.fr/inria-00107535
Contributor : Publications Loria <>
Submitted on : Thursday, October 19, 2006 - 9:00:22 AM
Last modification on : Thursday, January 11, 2018 - 6:19:55 AM
Long-term archiving on: Wednesday, March 29, 2017 - 12:58:24 PM

File

A01-R-341.pdf

Identifiers

  • HAL Id : inria-00107535, version 1

Collections

CNRS | INRIA | LORIA | UNIV-LORRAINE

Citation

Brigitte Bigi, Armelle Brun, Jean-Paul Haton, Kamel Smaïli, Imed Zitouni. A comparative study of Topic Identification on Newspaper and E-mail. Proceedings of the 8th International Symposium on String Processing and Information Retrieval - SPIRE'01, 2001, Laguna de San Rafael, Chili, pp.238-241. ⟨inria-00107535⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

432

Files downloads

218

 

 

Contact

archive-ouverte@inria.fr