HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant?

Abstract : The main aspects of XML retrieval are identified by analysing and comparing the following two behaviours: the behaviour of the assessor when judging the relevance of returned document components; and the behaviour of users when interacting with components of XML documents. We argue that the two INEX relevance dimensions, Exhaustivity and Specificity, are not orthogonal dimensions; indeed, an empirical analysis of each dimension reveals that the grades of the two dimensions are correlated to each other. By analysing the level of agreement between the assessor and the users, we aim at identifying the best units of retrieval. The results of our analysis show that the highest level of agreement is on highly relevant and on non-relevant document components, suggesting that only the end points of the INEX 10-point relevance scale are perceived in the same way by both the assessor and the users. We propose a new definition of relevance for XML retrieval and argue that its corresponding relevance scale would be a better choice for INEX.
Document type :
Conference papers
Complete list of metadata

Cited literature [22 references]  Display  Hide  Download

Contributor : Anne-Marie Vercoustre Connect in order to contact the contributor
Submitted on : Thursday, July 28, 2005 - 4:56:16 PM
Last modification on : Friday, February 4, 2022 - 3:19:40 AM
Long-term archiving on: : Thursday, April 1, 2010 - 10:08:41 PM




Jovan Pehcevski, James Thom, Anne-Marie Vercoustre. Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant?. INEX 2005 Workshop on Element Retrieval Methodology, University of Glasgow, Jul 2005, Glasgow, Scotland. ⟨inria-00000182⟩



Record views


Files downloads