Unsupervised Learning of Echo State Networks: A case study in Artificial Embryogeny.

Alexandre Devert 1 Nicolas Bredeche 1, 2 Marc Schoenauer 1
1 TANC - Algorithmic number theory for cryptology
LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau], Inria Saclay - Ile de France, X - École polytechnique, CNRS - Centre National de la Recherche Scientifique : UMR7161
Abstract : Echo State Networks (ESN) have demonstrated their efficiency in supervised learning of time series: a "reservoir" of neurons provide a set of dynamical systems that can be linearly combined to match the target dynamics, using a simple quadratic optimisation algorithm to tune the few free parameters. In an unsupervised learning context, however, another optimiser is needed. In this paper, an adaptive (1+1)-Evolution Strategy as well as the state-of-the-art CMA-ES are used to optimise an ESN to tackle the "flag" problem, a classical benchmark from multi-cellular artificial embryogeny: the genotype is the cell controller of a Continuous Cellular Automata, and the phenotype, the image that corresponds to the fixed point of the resulting dynamical system, must match a given 2D pattern. This approach is able to provide excellent results with few evaluations, and favourably compares to that using the NEAT algorithm (a state-of-the-art neuro-evolution method) to evolve the cell controllers. Some characteristics of the fitness landscape of the ESN-based method are also investigated.
Type de document :
Communication dans un congrès
Nicolas Monmarché and Talbi El-Ghazali and Pierre Collet and Marc Schoenauer and Evelyne Lutton. Evolution Artificielle, Oct 2007, Tours, France. 4926, pp.278-290, 2007, Lecture Notes in Computer Science
Liste complète des métadonnées

Littérature citée [32 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00174593
Contributeur : Nicolas Bredeche <>
Soumis le : lundi 24 septembre 2007 - 17:08:04
Dernière modification le : jeudi 10 mai 2018 - 02:07:00
Document(s) archivé(s) le : vendredi 9 avril 2010 - 02:45:54

Fichier

EA2007esndev.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00174593, version 1

Collections

Citation

Alexandre Devert, Nicolas Bredeche, Marc Schoenauer. Unsupervised Learning of Echo State Networks: A case study in Artificial Embryogeny.. Nicolas Monmarché and Talbi El-Ghazali and Pierre Collet and Marc Schoenauer and Evelyne Lutton. Evolution Artificielle, Oct 2007, Tours, France. 4926, pp.278-290, 2007, Lecture Notes in Computer Science. 〈inria-00174593〉

Partager

Métriques

Consultations de la notice

374

Téléchargements de fichiers

1086