AAAI Publications, Thirty-First AAAI Conference on Artificial Intelligence

Font Size: 
Thompson Sampling for Stochastic Bandits with Graph Feedback
Aristide C. Y. Tossou, Christos Dimitrakakis, Devdatt Dubhashi

Last modified: 2017-02-13

Abstract


We present a simple set of algorithms based on Thompson Sampling for stochastic bandit problems with graph feedback. Thompson Sampling is generally applicable, without the need to construct complicated upper confidence bounds. As we show in this paper, it has excellent performance in problems with graph feedback, even when the graph structure itself is unknown and/or changing. We provide theoretical guarantees on the Bayesian regret of the algorithm, as well as extensive experi- mental results on real and simulated networks. More specifically, we tested our algorithms on power law, planted partitions and Erdo's–Rényi graphs, as well as on graphs derived from Facebook and Flixster data and show that they clearly outperform related methods that employ upper confidence bounds.

Keywords


Thompson sampling;Stochastic multi-armed bandit;graphical learning;online learning

Full Text: PDF