The formation of habits: The implicit supervision of the basal ganglia

Meropi Topalidou 1, 2, 3 Camille Piron 1 Daisuke Kaise 1 Thomas Boraud 1 Nicolas P. Rougier 1, 2, 3
3 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : If basal ganglia are widely accepted to participate in the high-level cognitive function of decision-making, their role is less clear regarding the formation of habits. One of the biggest problem is to understand how goal-directed actions are transformed into habitual responses, or, said differently, how an animal can shift from an action-outcome (A-O) system to a stimulus-response (S-R) one while keeping a consistent behaviour? We introduce a computational model that can solve a simple two armed bandit task using reinforcement learning and explicit valuation of the outcome. Hebbian learning has been added at the cortical level such that the model learns each time a move is issued, rewarded or not. Then, by inhibiting the output nuclei of the model (GPi), we show how learning has been transferred from the basal ganglia to the cortex, simply as a consequence of the statistics of the choice. Because best (in the sense of most rewarded) actions are chosen more often, this directly impacts the amount of Hebbian learning and lead to the formation of habits within the cortex. These results have been confirmed in monkeys doing the same tasks where the BG has been inactivated using muscimol. This tends to show that the basal ganglia implicitely teach the cortex in order for it to learn the values of new options.
Type de document :
Poster
Fifth International Symposium on Biology of Decision Making (SBDM 2015), May 2015, Paris, France
Liste complète des métadonnées

https://hal.inria.fr/hal-01156477
Contributeur : Meropi Topalidou <>
Soumis le : jeudi 28 mai 2015 - 11:30:14
Dernière modification le : jeudi 11 janvier 2018 - 06:25:42
Document(s) archivé(s) le : lundi 24 avril 2017 - 15:52:17

Fichier

Topalidou-SBDM2015.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01156477, version 1

Citation

Meropi Topalidou, Camille Piron, Daisuke Kaise, Thomas Boraud, Nicolas P. Rougier. The formation of habits: The implicit supervision of the basal ganglia. Fifth International Symposium on Biology of Decision Making (SBDM 2015), May 2015, Paris, France. 〈hal-01156477〉

Partager

Métriques

Consultations de la notice

340

Téléchargements de fichiers

109