Online influence maximization under independent cascade model with semi-bandit feedback

Zheng Wen 1 Branislav Kveton 1 Michal Valko 2 Sharan Vaswani 3
2 SEQUEL - Sequential Learning
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : We study the online influence maximization problem in social networks under the independent cascade model. Specifically, we aim to learn the set of " best influencers " in a social network online while repeatedly interacting with it. We address the challenges of (i) combinatorial action space, since the number of feasible influencer sets grows exponentially with the maximum number of influencers, and (ii) limited feedback, since only the influenced portion of the network is observed. Under a stochastic semi-bandit feedback, we propose and analyze IMLinUCB, a computationally efficient UCB-based algorithm. Our bounds on the cumulative regret are polynomial in all quantities of interest, achieve near-optimal dependence on the number of interactions and reflect the topology of the network and the activation probabilities of its edges, thereby giving insights on the problem complexity. To the best of our knowledge, these are the first such results. Our experiments show that in several representative graph topologies, the regret of IMLinUCB scales as suggested by our upper bounds. IMLinUCB permits linear generalization and thus is both statistically and computationally suitable for large-scale problems. Our experiments also show that IMLinUCB with linear generalization can lead to low regret in real-world online influence maximization.
Document type :
Conference papers
Complete list of metadatas

Cited literature [34 references]  Display  Hide  Download

https://hal.inria.fr/hal-01643976
Contributor : Michal Valko <>
Submitted on : Tuesday, November 21, 2017 - 6:37:08 PM
Last modification on : Friday, March 22, 2019 - 1:36:09 AM

File

wen2017online.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01643976, version 1

Citation

Zheng Wen, Branislav Kveton, Michal Valko, Sharan Vaswani. Online influence maximization under independent cascade model with semi-bandit feedback. Neural Information Processing Systems, Dec 2017, Long Beach, United States. pp.1-24. ⟨hal-01643976⟩

Share

Metrics

Record views

432

Files downloads

55