Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons

Benoit Siri 1 Mathias Quoy 2 Bruno Delord 3 Bruno Cessac 4, 5 Hugues Berry 1
1 ALCHEMY - Architectures, Languages and Compilers to Harness the End of Moore Years
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France
5 ODYSSEE - Computer and biological vision
DI-ENS - Département d'informatique de l'École normale supérieure, CRISAM - Inria Sophia Antipolis - Méditerranée , ENS Paris - École normale supérieure - Paris, Inria Paris-Rocquencourt, ENPC - École des Ponts ParisTech
Abstract : The aim of the present paper is to study the effects of Hebbian learning in random recurrent neural networks with biological connectivity, i.e. sparse connections and separate populations of excitatory and inhibitory neurons. We furthermore consider that the neuron dynamics may occur at a (shorter) time scale than synaptic plasticity and consider the possibility of learning rules with passive forgetting. We show that the application of such Hebbian learning leads to drastic changes in the network dynamics and structure. In particular, the learning rule contracts the norm of the weight matrix and yields a rapid decay of the dynamics complexity and entropy. In other words, the network is rewired by Hebbian learning into a new synaptic structure that emerges with learning on the basis of the correlations that progressively build up between neurons. We also observe that, within this emerging structure, the strongest synapses organize as a small-world network. The second effect of the decay of the weight matrix spectral radius consists in a rapid contraction of the spectral radius of the Jacobian matrix. This drives the system through the ``edge of chaos'' where sensitivity to the input pattern is maximal. Taken together, this scenario is remarkably predicted by theoretical arguments derived from dynamical systems and graph theory.
Type de document :
Autre publication
2007
Liste complète des métadonnées

Littérature citée [45 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00155580
Contributeur : Hugues Berry <>
Soumis le : lundi 18 juin 2007 - 15:39:04
Dernière modification le : vendredi 12 janvier 2018 - 01:55:38
Document(s) archivé(s) le : jeudi 8 avril 2010 - 20:40:00

Fichiers

Siri_JPhysParis07.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00155580, version 1
  • ARXIV : 0706.2602

Citation

Benoit Siri, Mathias Quoy, Bruno Delord, Bruno Cessac, Hugues Berry. Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons. 2007. 〈inria-00155580〉

Partager

Métriques

Consultations de la notice

633

Téléchargements de fichiers

239