Looking for Scalable Agents

Olivier Buffet 1 Alain Dutech 1
1 MAIA - Autonomous intelligent machine
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Reinforcement Learning intends to ease and possibly to perform automatically the design of systems such as software or robot agents. An important aspect is the ability of learning agents to adapt to their environment and to the task they have to accomplish. This kind of learning is unfortunately restrained by problems like combinatorial explosion of the state space that limits the number of sensors or objects an agent can reasonably deal with, especially in the case of Multi-Agent Systems. Considering Markov Decision Processes, different solutions exist to overcome the difficulties related to large state spaces: hierarchical structures \cite{Parr98} or factored representations \cite{Kearns99} of the agent's behavior for example. Nevertheless, these tools require manual preparations before going through the learning step, and result in an agent designed for a specific task. The work presented here intends to define agents able to be efficient in several complex situations, reusing prior knowledge (see also \cite{Dixon00}). The design is based on the use of many basic behaviors which the agent will have to manage, each behavior corresponding to a different motivation. For now, Reinforcement Learning is mainly employed for the ``recording'' of these basic behaviors. Nevertheless there is place for improvements of our framework through other uses of Reinforcement Learning.
Type de document :
Communication dans un congrès
European Workshop On Reinforcement Learning, 2001, Utrecht, The Netherlands, 2 p, 2001
Liste complète des métadonnées

Contributeur : Publications Loria <>
Soumis le : mardi 26 septembre 2006 - 14:46:34
Dernière modification le : jeudi 11 janvier 2018 - 06:19:50


  • HAL Id : inria-00100537, version 1



Olivier Buffet, Alain Dutech. Looking for Scalable Agents. European Workshop On Reinforcement Learning, 2001, Utrecht, The Netherlands, 2 p, 2001. 〈inria-00100537〉



Consultations de la notice