3532 articles – 5253 Notices  [english version]

inria-00586245, version 1

Reinforcement Learning and Dimensionality Reduction: a model in Computational Neuroscience

Nishal Shah 1, Frédéric Alexandre () 2

International Joint Conference on Neural Networks IJCNN 2011 (2011)

Résumé : Basal Ganglia, a group of sub-cortical neuronal nuclei in the brain, are commonly described as the neuronal substratum to Reinforcement Learning. Since the seminal work by Schultz [1], a huge amount of work has been done to deepen that analogy, from functional and anatomic points of view. Nevertheless, a noteworthy architectural hint has been hardly explored: the outstanding reduction of dimensionality from the input to the output of the basal ganglia. Bar-Gad et al. [2] have suggested that this transformation could correspond to a Principal Component Analysis but did not explore the full functional consequences of this hypothesis. In this paper, we propose to study this mechanism within a model more realistic from a computational neuroscience point of view. Particularly, we show its feasibility when the loop is closed, in the framework of Action Selection.

  • 1 :  Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • 2 :  CORTEX (INRIA Lorraine - LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • Domaine : Informatique/Réseau de neurones
 
  • inria-00586245, version 1
  • oai:hal.inria.fr:inria-00586245
  • Contributeur : 
  • Soumis le : Vendredi 15 Avril 2011, 12:57:36
  • Dernière modification le : Vendredi 25 Novembre 2011, 13:47:18