3532 articles – 5253 references  [version française]

inria-00586245, version 1

Reinforcement Learning and Dimensionality Reduction: a model in Computational Neuroscience

Nishal Shah 1, Frédéric Alexandre () 2

International Joint Conference on Neural Networks IJCNN 2011 (2011)

Abstract: Basal Ganglia, a group of sub-cortical neuronal nuclei in the brain, are commonly described as the neuronal substratum to Reinforcement Learning. Since the seminal work by Schultz [1], a huge amount of work has been done to deepen that analogy, from functional and anatomic points of view. Nevertheless, a noteworthy architectural hint has been hardly explored: the outstanding reduction of dimensionality from the input to the output of the basal ganglia. Bar-Gad et al. [2] have suggested that this transformation could correspond to a Principal Component Analysis but did not explore the full functional consequences of this hypothesis. In this paper, we propose to study this mechanism within a model more realistic from a computational neuroscience point of view. Particularly, we show its feasibility when the loop is closed, in the framework of Action Selection.

  • 1:  Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • 2:  CORTEX (INRIA Lorraine - LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • Domain : Computer Science/Neural and Evolutionary Computing
 
  • inria-00586245, version 1
  • oai:hal.inria.fr:inria-00586245
  • From: 
  • Submitted on: Friday, 15 April 2011 12:57:36
  • Updated on: Friday, 25 November 2011 13:47:18