Looking for “Good” Recommendations: A Comparative Evaluation of Recommender Systems

Abstract : A number of researches in the Recommender Systems (RSs) domain suggest that the recommendations that are “best” according to objective metrics are sometimes not the ones that are most satisfactory or useful to the users. The paper investigates the quality of RSs from a user-centric perspective. We discuss an empirical study that involved 210 users and considered seven RSs on the same dataset that use different baseline and state-of-the-art recommendation algorithms. We measured the user’s perceived quality of each of them, focusing on accuracy and novelty of recommended items, and on overall users’ satisfaction. We ranked the considered recommenders with respect to these attributes, and compared these results against measures of statistical quality of the considered algorithms as they have been assessed by past studies in the field using information retrieval and machine learning algorithms.
Document type :
Conference papers
Complete list of metadatas

Cited literature [26 references]  Display  Hide  Download

https://hal.inria.fr/hal-01591811
Contributor : Hal Ifip <>
Submitted on : Friday, September 22, 2017 - 9:24:08 AM
Last modification on : Tuesday, August 13, 2019 - 11:10:03 AM
Long-term archiving on: Saturday, December 23, 2017 - 12:10:27 PM

File

978-3-642-23765-2_11_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Paolo Cremonesi, Franca Garzotto, Sara Negro, Alessandro Papadopoulos, Roberto Turrin. Looking for “Good” Recommendations: A Comparative Evaluation of Recommender Systems. 13th International Conference on Human-Computer Interaction (INTERACT), Sep 2011, Lisbon, Portugal. pp.152-168, ⟨10.1007/978-3-642-23765-2_11⟩. ⟨hal-01591811⟩

Share

Metrics

Record views

86

Files downloads

415