Decision making mechanisms in a connectionist model of the basal ganglia

Abstract : The mechanisms of decision making are generally thought to be under the control of a set of cortico-subcortical loops. There are several parallel functional loops through the basal ganglia connecting back to distinct areas of cortex, process- ing different modalities of decision making, including motor, cognitive and limbic. Due to convergence and divergence within the network, these loops cannot be completely segregated. We use these circuit properties to develop a connec- tionist model at a spiking neuron level of description, relying on the bases of the recently published Guthrie’s model1. This model is applied to a decision making task that has been studied in primates. The electrophysiological results of this work showed that the decision process is done in two successive steps. In this task, the animals are trained to associate reward values to target shapes in order to maximize their gain2. To develop this model, we use two parallel loops, each of which performs decision making based on interactions between positive and negative feedback pathways within the loop. The loops communicate via partially convergent and divergent connections in one specific area. This model is tested to perform a two level decision making as in primates. The whole system is instantiated using leaky integrate- and-fire neurons and its architecture relies on commonly accepted data regarding the complex functional connectivity description between basal ganglia, cortex and thalamus. A bottom-up approach of the basal ganglia model in which the learning of optimum decision making is thus developed. This capability will emerge from the closed-loop interaction between the neural circuitry and its sensory-motor interface. This model will allow us (i) to avoid the arbitrary choice of a pre-existing machine-learning derivative model and also provides (ii) to have the possibility to investigate the cell-scale mechanisms impact on the whole model capacities.
Liste complète des métadonnées

Littérature citée [2 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01206514
Contributeur : Charlotte Héricé <>
Soumis le : mardi 29 septembre 2015 - 11:04:40
Dernière modification le : jeudi 11 janvier 2018 - 06:25:42
Document(s) archivé(s) le : mercredi 30 décembre 2015 - 10:33:39

Fichier

Poster_RLDM.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01206514, version 1

Collections

Citation

Charlotte Héricé, Radwa Khalil, Maria Moftah, Thomas Boraud, Martin Guthrie, et al.. Decision making mechanisms in a connectionist model of the basal ganglia. The Multi-disciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2015), Jun 2015, Edmonton, Canada. 〈http://rldm.org〉. 〈hal-01206514〉

Partager

Métriques

Consultations de la notice

443

Téléchargements de fichiers

151