Evaluating Relevant in Context: Document Retrieval with a Twist

Abstract : The Relevant in Context retrieval task is document or article retrieval with a twist, where not only the relevant articles should be retrieved but also the relevant information within each article (captured by a set of XML elements) should be correctly identified. Our main research question is: how to evaluate the Relevant in Context task? We propose a generalized average precision measure that meets two main requirements: i) the score reflects the ranked list of articles inherent in the result list, and at the same time ii) the score also reflects how well the retrieved information per article (i.e., the set of elements) corresponds to the relevant information. The resulting measure was used at INEX 2006.
Type de document :
Communication dans un congrès
30th annual international ACM SIGIR conference on Research and development in information retrieval, Jul 2007, Amsterdam, Netherlands. 2007
Liste complète des métadonnées

Littérature citée [2 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00174140
Contributeur : Jovan Pehcevski <>
Soumis le : vendredi 21 septembre 2007 - 15:49:14
Dernière modification le : mardi 17 avril 2018 - 11:25:13
Document(s) archivé(s) le : lundi 24 septembre 2012 - 12:36:49

Fichier

sigir07aic.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00174140, version 1

Collections

Citation

Jaap Kamps, Mounia Lalmas, Jovan Pehcevski. Evaluating Relevant in Context: Document Retrieval with a Twist. 30th annual international ACM SIGIR conference on Research and development in information retrieval, Jul 2007, Amsterdam, Netherlands. 2007. 〈inria-00174140〉

Partager

Métriques

Consultations de la notice

166

Téléchargements de fichiers

86