HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

Control of Buffer and Energy of a Wireless Device: Closed and Open Loop Approaches

Abstract : We consider a decision problem faced by an energy limited wireless device that operates in discrete time. There is some external arrival to the device's transmit buffer. The possible decisions are a) to serve some of the buffer content, b) to reorder a new battery after serving the maximum possible amount that it can, and c) to remain idle so that the battery charge can increase owing to diffusion process (possible in some commercially available battery). We look at both open-loop and closed-loop control of the system. For the closed-loop control, we view the problem in the framework of Markov Decision Processes and address finite and infinite horizon discounted costs as well as average cost minimization problems. Without using any second order characteristics, we obtain results that include i) optimality of bang-bang control, ii) the optimality of threshold based policies, iii) parameteric monotonicity of the threshold, and iv) uniqueness of the threshold. For the open-loop control setting we use recent advances in application of multimodular functions to establish optimality of bracket sequence based control.
Document type :
Complete list of metadata

Cited literature [1 references]  Display  Hide  Download

Contributor : Rapport de Recherche Inria Connect in order to contact the contributor
Submitted on : Friday, May 19, 2006 - 8:57:35 PM
Last modification on : Thursday, January 20, 2022 - 4:15:12 PM
Long-term archiving on: : Sunday, April 4, 2010 - 9:32:13 PM


  • HAL Id : inria-00070592, version 1



V. S. Borkar, A. A. Kherani, Balakrishna Prabhu. Control of Buffer and Energy of a Wireless Device: Closed and Open Loop Approaches. [Research Report] RR-5414, INRIA. 2006, pp.24. ⟨inria-00070592⟩



Record views


Files downloads