C. Li and M. J. Neely, Energy-optimal scheduling with dynamic channel acquisition in wireless downlinks, IEEE Trans. Mobile Comput, vol.9, issue.4, pp.527-539, 2010.

H. S. Wang and P. Chang, On verifying the first-order Markovian assumption for a Rayleigh fading channel model, IEEE Transactions on Vehicular Technology, vol.45, issue.2, pp.353-357, 1996.
DOI : 10.1109/25.492909

M. Zorzi, R. R. Rao, and L. B. Milstein, A Markov model for block errors on fading channels, Proceedings of PIMRC '96, 7th International Symposium on Personal, Indoor, and Mobile Communications, 1996.
DOI : 10.1109/PIMRC.1996.568447

D. P. Bertsekas, Dynamic Programming and Optimal Control, Athena Scientific, vol.I, 2005.

Q. Zhao, B. Krishnamachari, and K. Liu, On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance, IEEE Transactions on Wireless Communications, vol.7, issue.12, pp.5431-5440, 2008.
DOI : 10.1109/T-WC.2008.071349

S. H. Ahmad, M. Liu, T. Javidi, Q. Zhao, and B. Krishnamachari, Optimality of Myopic Sensing in Multichannel Opportunistic Access, IEEE Transactions on Information Theory, vol.55, issue.9, pp.4040-4050, 2009.
DOI : 10.1109/TIT.2009.2025561

M. J. Neely, Stochastic optimization for Markov modulated networks with application to delay constrained wireless scheduling, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, 2009.
DOI : 10.1109/CDC.2009.5400270

Q. Zhao and A. Swami, A Decision-Theoretic Framework for Opportunistic Spectrum Access, IEEE Wireless Communications, vol.14, issue.4, pp.14-20, 2007.
DOI : 10.1109/MWC.2007.4300978

A. Pantelidou, A. Ephremides, and A. L. Tits, Joint Scheduling and Routing for Ad-hoc Networks Under Channel State Uncertainty, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops, 2007.
DOI : 10.1109/WIOPT.2007.4480047

L. Ying and S. Shakkottai, On Throughput Optimality With Delayed Network-State Information, Information Theory and Application Workshop (ITA), pp.339-344, 2008.
DOI : 10.1109/TIT.2011.2158879

P. Chaporkar, A. Proutiere, H. Asnani, and A. Karandikar, Scheduling with limited information in wireless systems, Proceedings of the tenth ACM international symposium on Mobile ad hoc networking and computing, MobiHoc '09, 2009.
DOI : 10.1145/1530748.1530759

R. G. Gallager, Discrete Stochastic Processes, Journal of the Operational Research Society, vol.48, issue.1, 1996.
DOI : 10.1057/palgrave.jors.2600329

C. Li and M. J. Neely, Exploiting channel memory for multiuser wireless scheduling without channel measurement: Capacity regions and algorithms, Performance Evaluation, vol.68, issue.8, 2010.
DOI : 10.1016/j.peva.2011.01.007
URL : https://hal.archives-ouvertes.fr/inria-00498392

P. Whittle, Restless bandits: activity allocation in a changing world, Journal of Applied Probability, vol.1, issue.A, pp.287-298, 1988.
DOI : 10.1214/aop/1176994469

J. C. Gittins, Multi-Armed Bandit Allocation Indices, 1989.
DOI : 10.1002/9780470980033

L. Tassiulas and A. Ephremides, Dynamic server allocation to parallel queues with randomly varying connectivity, IEEE Transactions on Information Theory, vol.39, issue.2, pp.466-478, 1993.
DOI : 10.1109/18.212277

L. Georgiadis, M. J. Neely, and L. Tassiulas, Resource Allocation and Cross-Layer Control in Wireless Networks, Foundations and Trends?? in Networking, vol.1, issue.1, 2006.
DOI : 10.1561/1300000001