Adaptive Shortest-Path Routing under Unknown and Stochastically Varying Link States - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Adaptive Shortest-Path Routing under Unknown and Stochastically Varying Link States

Résumé

We consider adaptive shortest-path routing in wireless networks. In this problem, we aim to optimize the quality of communication between a source and a destination through adaptive path selection. Due to the randomness and uncertainties in the network dynamics, the state of each communication link varies over time according to a stochastic process with unknown distributions. The link states are not directly observable. The aggregated end-to-end cost of a path from the source to the destination is revealed after the path is chosen for communication. The objective is an adaptive path selection algorithm that minimizes regret defined as the additional cost over the ideal scenario where the best path is known a priori. This problem can be cast as a variation of the classic multi-armed bandit (MAB) problem with each path as an arm and arms dependent through common links. We show that by exploiting arm dependencies, a regret polynomial with the network size can be achieved while maintaining the optimal logarithmic order with time. This is in sharp contrast with the exponential regret order with the network size offered by a direct application of the classic MAB policies that ignores arm dependencies. Furthermore, our results are obtained under a general model of link state distributions (including heavy-tailed distributions). These results find applications in cognitive radio and ad hoc networks with unknown and dynamic communication environments.
Fichier principal
Vignette du fichier
p232-liu.pdf (275.56 Ko) Télécharger le fichier
Origine : Accord explicite pour ce dépôt

Dates et versions

hal-00763780 , version 1 (11-12-2012)

Identifiants

  • HAL Id : hal-00763780 , version 1

Citer

Keqin Liu, Qing Zhao. Adaptive Shortest-Path Routing under Unknown and Stochastically Varying Link States. WiOpt'12: Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks, May 2012, Paderborn, Germany. pp.232-237. ⟨hal-00763780⟩

Collections

WIOPT2012
33 Consultations
160 Téléchargements

Partager

Gmail Facebook X LinkedIn More