Slow Fading Channel Selection: A Restless Multi-Armed Bandit Formulation

Abstract : We deal with a multi-access wireless network in which transmitters dynamically select a frequency band to communicate on. The slow fading channel attenuations follow an autoregressive model. In the single user case, we formulate this selection problem as a restless multi-armed bandit problem and we propose two strategies to dynamically select a band at each time slot. Our objective is to maximize the SNR in the long run. Each of these strategies is close to the optimal strategy in different regimes. In the general case with several users, we formulate the problem as a stochastic game with uncountable state space, where the objective is the SINR. Then we propose two strategies to approximate the best response policy for one user when the other users' strategy is fixed.
Document type :
Conference papers
Complete list of metadatas
Contributor : Konstantin Avrachenkov <>
Submitted on : Wednesday, December 12, 2012 - 11:32:59 AM
Last modification on : Saturday, January 27, 2018 - 1:31:43 AM




Konstantin Avrachenkov, Laura Cottatellucci, Lorenzo Maggi. Slow Fading Channel Selection: A Restless Multi-Armed Bandit Formulation. ISWCS'12: The 9th International Symposium on Wireless Communication Systems, Aug 2012, Paris, France. pp.1083 - 1087, ⟨10.1109/ISWCS.2012.6328535⟩. ⟨hal-00764057⟩



Record views