Feature Discovery in Reinforcement Learning using Genetic Programming - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2007

Feature Discovery in Reinforcement Learning using Genetic Programming

Sertan Girgin
  • Fonction : Auteur
  • PersonId : 844332
Philippe Preux

Résumé

The goal of reinforcement learning is to find a policy that maximizes the expected reward accumulated by an agent over time based on its interactions with the environment; to this end, a function of the state of the agent has to be learned. It is often the case that states are better characterized by a set of features. However, finding a ''good'' set of features is generally a tedious task which requires a good domain knowledge. In this paper, we propose a genetic programming based approach for feature discovery in reinforcement learning. A population of individuals, each representing a set of features is evolved, and individuals are evaluated by their average performance on short reinforcement learning trials. The results of experiments conducted on several benchmark problems demonstrate that the resulting features allow the agent to learn better policies in a reduced amount of episodes.
Fichier principal
Vignette du fichier
RR-6358.pdf (203.06 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00187997 , version 1 (15-11-2007)
inria-00187997 , version 2 (19-11-2007)

Identifiants

  • HAL Id : inria-00187997 , version 2

Citer

Sertan Girgin, Philippe Preux. Feature Discovery in Reinforcement Learning using Genetic Programming. [Research Report] INRIA. 2007. ⟨inria-00187997v2⟩
200 Consultations
1257 Téléchargements

Partager

Gmail Facebook X LinkedIn More