Skip to Main content Skip to Navigation
Conference papers

A Decision-Theoretic Scheduling of Resource-Bounded Agents in Dynamic Environments

Simon Le Gloannec 1, 2 Abdel-Illah Mouaddib 1 François Charpillet 2
1 Equipe MAD - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
2 MAIA - Autonomous intelligent machine
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Markov Decision processes have been widely used to control the execution of a static set of tasks with limited resources. But little attention has been paid to adapt these techniques to cope with changes in the environment. This is a problem of the dynamic optimisation of resource allocation to a changing set of tasks. We transform this problem into a dynamic composition of local policies (each of which controls a task) to approximate the optimal control policy. Our main claim in this paper is that it is possible to dynamically compute good decisions without completely calculating the optimal policy. We develop an approach which provides more flexibility for MDPs to deal with dynamic environments. This approach is made up of two steps. The first step consists of an off-line pre-processing of tasks and the compilation of policies for all possible available resources. The second step concerns a quick on-line approximation of the policy of executing the current task taking into account the current state of the queue. We present a preliminary analysis of the performance of our approach.
Document type :
Conference papers
Complete list of metadatas

Cited literature [6 references]  Display  Hide  Download

https://hal.inria.fr/inria-00000414
Contributor : Simon Le Gloannec <>
Submitted on : Monday, October 10, 2005 - 10:36:16 AM
Last modification on : Tuesday, April 2, 2019 - 1:33:58 AM
Long-term archiving on: : Thursday, April 1, 2010 - 10:41:35 PM

Identifiers

  • HAL Id : inria-00000414, version 1

Citation

Simon Le Gloannec, Abdel-Illah Mouaddib, François Charpillet. A Decision-Theoretic Scheduling of Resource-Bounded Agents in Dynamic Environments. International Conference on Automated Planning and Scheduling - ICAPS 2005, Jul 2005, Monterey, California/USA, United States. ⟨inria-00000414⟩

Share

Metrics

Record views

391

Files downloads

225