inria-00586245, version 1
Reinforcement Learning and Dimensionality Reduction: a model in Computational Neuroscience
International Joint Conference on Neural Networks IJCNN 2011 (2011)
Résumé : Basal Ganglia, a group of sub-cortical neuronal nuclei in the brain, are commonly described as the neuronal substratum to Reinforcement Learning. Since the seminal work by Schultz [1], a huge amount of work has been done to deepen that analogy, from functional and anatomic points of view. Nevertheless, a noteworthy architectural hint has been hardly explored: the outstanding reduction of dimensionality from the input to the output of the basal ganglia. Bar-Gad et al. [2] have suggested that this transformation could correspond to a Principal Component Analysis but did not explore the full functional consequences of this hypothesis. In this paper, we propose to study this mechanism within a model more realistic from a computational neuroscience point of view. Particularly, we show its feasibility when the loop is closed, in the framework of Action Selection.
- 1 :
- INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
- 2 :
- INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
- Domaine : Informatique/Réseau de neurones
- inria-00586245, version 1
- http://hal.inria.fr/inria-00586245
- oai:hal.inria.fr:inria-00586245
- Contributeur :
- Soumis le : Vendredi 15 Avril 2011, 12:57:36
- Dernière modification le : Vendredi 25 Novembre 2011, 13:47:18


Documents associés
Exporter