Skip to Main content Skip to Navigation
Conference papers

Evaluating search engines and defining a consensus implementation

Abstract : Different search engines provide different outputs for the same keyword. This may be due to different definitions of relevance, and/or to different knowledge/anticipation of users' preferences, but rankings are also suspected to be biased towards own content, which may prejudicial to other content providers. In this paper, we make some initial steps toward a rigorous comparison and analysis of search engines, by proposing a definition for a consensual relevance of a page with respect to a keyword, from a set of search engines. More specifically, we look at the results of several search engines for a sample of keywords, and define for each keyword the visibility of a page based on its ranking over all search engines. This allows to define a score of the search engine for a keyword, and then its average score over all keywords. Based on the pages visibility, we can also define the consensus search engine as the one showing the most visible results for each keyword. We have implemented this model and present an analysis of the results.
Complete list of metadata

Cited literature [8 references]  Display  Hide  Download

https://hal.inria.fr/hal-01852650
Contributor : Bruno Tuffin <>
Submitted on : Thursday, August 2, 2018 - 9:57:42 AM
Last modification on : Wednesday, August 5, 2020 - 3:42:27 AM
Long-term archiving on: : Saturday, November 3, 2018 - 2:19:32 PM

Files

ConsensusSE-all-in-one.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01852650, version 1
  • ARXIV : 1808.00958

Citation

Ahmed Kamoun, Patrick Maillé, Bruno Tuffin. Evaluating search engines and defining a consensus implementation. VALUETOOLS 2019 - 12th EAI International Conference on Performance Evaluation Methodologies and Tools, Mar 2019, Palma de Majorque, Spain. pp.1-10. ⟨hal-01852650⟩

Share

Metrics

Record views

612

Files downloads

285