User Engagement as Evaluation: a Ranking or a Regression Problem?

Frédéric Guillou 1, 2 Romaric Gaudel 1, 2 Jérémie Mary 1, 2 Philippe Preux 1, 2
1 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
Abstract : In this paper, we describe the winning approach used on the RecSys Challenge 2014 which focuses on employing user en-gagement as evaluation of recommendations. On one hand, we regard the challenge as a ranking problem and apply the LambdaMART algorithm, which is a listwise model special-ized in a Learning To Rank approach. On the other hand, after noticing some specific characteristics of this challenge, we also consider it as a regression problem and use pointwise regression models such as Random Forests. We compare how these different methods can be modified or combined to improve the accuracy and robustness of our model and we draw the advantages or disadvantages of each approach.
Document type :
Other publications
Complete list of metadatas

Cited literature [12 references]  Display  Hide  Download

https://hal.inria.fr/hal-01077986
Contributor : Frédéric Guillou <>
Submitted on : Monday, October 27, 2014 - 3:37:37 PM
Last modification on : Thursday, February 21, 2019 - 10:52:49 AM
Long-term archiving on : Wednesday, January 28, 2015 - 11:41:38 AM

File

Paper Recsys.pdf
Files produced by the author(s)

Identifiers

Citation

Frédéric Guillou, Romaric Gaudel, Jérémie Mary, Philippe Preux. User Engagement as Evaluation: a Ranking or a Regression Problem?. 2014, ⟨10.1145/2668067.2668073⟩. ⟨hal-01077986⟩

Share

Metrics

Record views

288

Files downloads

467