Incremental Basis Function Expansion in Reinforcement Learning using Cascade-Correlation Networks - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2008

Incremental Basis Function Expansion in Reinforcement Learning using Cascade-Correlation Networks

Sertan Girgin
  • Fonction : Auteur
  • PersonId : 844332

Résumé

In machine learning, in parallel to algorithms themselves, the representation of data is a point of utmost importance. Efforts on data pre-processing in general are a key ingredient to success. An algorithm that performs poorly on a particular form of given data may perform much better, both in terms of efficiency and the quality of the solution, when the same data is represented in another form. Despite the amount of literature on the subject, the issue of how to enrich a representation to suit the underlying mechanism is clearly still pending. In this paper, we approach this problem within the context of reinforcement learning, and in particular, interested in discovery of a ''good'' representation of data for the LSPI algorithm. To this end, we use the cascade-correlation learning architecture to automatically generate a set of basis functions which would lead to a better approximation of the value function, and consequently improve the performance of the resulting policies. We also show the effectiveness of the idea on some benchmark problems.
Fichier principal
Vignette du fichier
inria.pdf (351.13 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00272368 , version 1 (11-04-2008)
inria-00272368 , version 2 (21-04-2008)

Identifiants

  • HAL Id : inria-00272368 , version 2

Citer

Sertan Girgin, Philippe Preux. Incremental Basis Function Expansion in Reinforcement Learning using Cascade-Correlation Networks. [Research Report] RR-6505, INRIA. 2008. ⟨inria-00272368v2⟩
211 Consultations
305 Téléchargements

Partager

Gmail Facebook X LinkedIn More