Feature Discovery in Reinforcement Learning using Genetic Programming

Sertan Girgin 1 Philippe Preux 1
1 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
Abstract : The goal of reinforcement learning is to find a policy that maximizes the expected reward accumulated by an agent over time based on its interactions with the environment; to this end, a function of the state of the agent has to be learned. It is often the case that states are better characterized by a set of features. However, finding a ''good'' set of features is generally a tedious task which requires a good domain knowledge. In this paper, we propose a genetic programming based approach for feature discovery in reinforcement learning. A population of individuals, each representing a set of features is evolved, and individuals are evaluated by their average performance on short reinforcement learning trials. The results of experiments conducted on several benchmark problems demonstrate that the resulting features allow the agent to learn better policies in a reduced amount of episodes.
Type de document :
Rapport
[Research Report] INRIA. 2007
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00187997
Contributeur : Rapport de Recherche Inria <>
Soumis le : lundi 19 novembre 2007 - 10:25:48
Dernière modification le : jeudi 11 janvier 2018 - 06:22:13
Document(s) archivé(s) le : lundi 27 juin 2011 - 16:55:09

Fichiers

RR-6358.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00187997, version 2

Collections

Citation

Sertan Girgin, Philippe Preux. Feature Discovery in Reinforcement Learning using Genetic Programming. [Research Report] INRIA. 2007. 〈inria-00187997v2〉

Partager

Métriques

Consultations de la notice

365

Téléchargements de fichiers

885