| HAL-Inria | Publications, software ... of Inria's scientists |
Conference papers
Spectral Bandits for Smooth Graph Functions with Applications in Recommender Systems
Abstract : Smooth functions on graphs have wide applications in manifold and semi-supervised learning. In this paper, we study a bandit problem where the payoffs of arms are smooth on a graph. This framework is suitable for solving online learning problems that involve graphs, such as content-based recommendation. In this problem, each recommended item is a node and its expected rating is similar to its neighbors. The goal is to recommend items that have high expected ratings. We aim for the algorithms where the cumulative regret would not scale poorly with the number of nodes. In particular, we introduce the notion of an effective dimension, which is small in real-world graphs, and propose two algorithms for solving our problem that scale linearly in this dimension. Our experiments on real-world content recommendation problem show that a good estimator of user preferences for thousands of items can be learned from just tens nodes evaluations.
Cited literature [13 references]
https://hal.inria.fr/hal-01045036
Contributor : Michal Valko <>
Submitted on : Thursday, July 24, 2014 - 2:58:25 PM
Last modification on : Tuesday, November 24, 2020 - 2:18:20 PM
Long-term archiving on: : Tuesday, November 25, 2014 - 4:46:25 PM
Contributor : Michal Valko <>
Submitted on : Thursday, July 24, 2014 - 2:58:25 PM
Last modification on : Tuesday, November 24, 2020 - 2:18:20 PM
Long-term archiving on: : Tuesday, November 25, 2014 - 4:46:25 PM
File
Spectral_Bandits.pdf
Files produced by the author(s)