Decision-making in a neural network model of the basal ganglia

Charlotte Héricé 1, 2, 3 Radwa Khalil 2 Maria Moftah 4 Thomas Boraud 2, 1 Martin Guthrie 2 André Garenne 2, 3, 1
3 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : The mechanisms of decision-making are generally thought to be under the control of a set of cortico-subcortical loops involving basal ganglia and thalamic pathways. These structures include several parallel functional loops connecting back to distinct areas of cortex, processing motor, cognitive and limbic modalities of decision making. Due to convergence and divergence within the network, these loops cannot be completely segregated. We used these circuit properties to develop a computational model at a spiking neuron level of description. The model was implemented using leaky integrate-and-fire neuronal models connected by voltage-jump synapses and its architecture relied on commonly accepted data regarding the complex functional connectivity description between basal ganglia, cortex and thalamus. This model was applied to a decision making task which was initially studied in primates. In this task, the animals were trained to associate reward probabilities to different cues they had to select in order to maximize their gain. Combining behavioral and electrophysiological experimental data from this study and detailed circuit description, we developed a basal ganglia model in which we used two parallel loops, each of which performed decision making based on interactions between positive and negative feedback pathways. The loops communicate via partially convergent and divergent connections in specific basal ganglia sub-regions. This neuronal network model was then trained to perform the same decision making task as in primates. This training resulted from the closed-loop interaction between the neural circuitry and its sensory-motor interface. The learning was implemented as a cortico-striatal synaptic weight variation modulated by phasic dopamine release following the presence or absence of reward delivery. Thanks to this simple bottom-up approach the model was able to learn to select optimum reward cues in a similar manner as the monkey. Moreover, this model allows us (i) to avoid the arbitrary choice of a pre-existing machine-learning derivative model, (ii) to investigate lesional and pharmacological effects on learning and decision making and (iii) also provides the possibility to test for further hypotheses regarding cell-scale mechanisms effect on the whole model capacities.
Liste complète des métadonnées

https://hal.inria.fr/hal-01368504
Contributeur : Charlotte Héricé <>
Soumis le : lundi 19 septembre 2016 - 16:03:59
Dernière modification le : jeudi 11 janvier 2018 - 06:25:42

Fichier

Poster_SBDM_2016.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01368504, version 1

Collections

Citation

Charlotte Héricé, Radwa Khalil, Maria Moftah, Thomas Boraud, Martin Guthrie, et al.. Decision-making in a neural network model of the basal ganglia. Sixth International Symposium on Biology of Decision Making (SBDM 2016), May 2016, Paris France. 〈http://sbdm2016.isir.upmc.fr〉. 〈hal-01368504〉

Partager

Métriques

Consultations de la notice

263

Téléchargements de fichiers

77