Online influence maximization under independent cascade model with semi-bandit feedback

Zheng Wen 1 Branislav Kveton 1 Michal Valko 2 Sharan Vaswani 3
2 SEQUEL - Sequential Learning
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : We study the online influence maximization problem in social networks under the independent cascade model. Specifically, we aim to learn the set of " best influencers " in a social network online while repeatedly interacting with it. We address the challenges of (i) combinatorial action space, since the number of feasible influencer sets grows exponentially with the maximum number of influencers, and (ii) limited feedback, since only the influenced portion of the network is observed. Under a stochastic semi-bandit feedback, we propose and analyze IMLinUCB, a computationally efficient UCB-based algorithm. Our bounds on the cumulative regret are polynomial in all quantities of interest, achieve near-optimal dependence on the number of interactions and reflect the topology of the network and the activation probabilities of its edges, thereby giving insights on the problem complexity. To the best of our knowledge, these are the first such results. Our experiments show that in several representative graph topologies, the regret of IMLinUCB scales as suggested by our upper bounds. IMLinUCB permits linear generalization and thus is both statistically and computationally suitable for large-scale problems. Our experiments also show that IMLinUCB with linear generalization can lead to low regret in real-world online influence maximization.
Type de document :
Communication dans un congrès
Neural Information Processing Systems, Dec 2017, Long Beach, United States. pp.1-24
Liste complète des métadonnées

Littérature citée [34 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01643976
Contributeur : Michal Valko <>
Soumis le : mardi 21 novembre 2017 - 18:37:08
Dernière modification le : mardi 3 juillet 2018 - 11:38:32

Fichier

wen2017online.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01643976, version 1

Citation

Zheng Wen, Branislav Kveton, Michal Valko, Sharan Vaswani. Online influence maximization under independent cascade model with semi-bandit feedback. Neural Information Processing Systems, Dec 2017, Long Beach, United States. pp.1-24. 〈hal-01643976〉

Partager

Métriques

Consultations de la notice

390

Téléchargements de fichiers

34