One critic for two actors

Nicolas P. Rougier 1, 2, 3
3 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : We introduces a new hypothesis concerning the dissociated role of the basal ganglia in the selection and the evaluation of action that has been formulated using a theoretical model and confirmed experimentally in monkeys. To do so, and prior to learning, we inactivated the internal part of the Globus Pallidus (GPi, the main output structure of the BG) with injections of Muscimol and we tested monkeys on a variant of a two-armed bandit task where two stimuli are associated with two distinct reward probabilities (0.25 and 0.75 respectively). Unsurprisingly, performance in such condition are at the chance level since the output of basal ganglia cannot influence behaviour. However, the theoretical model predicts that in the meantime, values of the stimuli are nonetheless covertly evaluated and learned. This has been tested and confirmed on the next day, when inhibition has been removed: monkeys instantly showed significant improved performances (above chance level), hence demonstrating they have learned and knew the relative value of the two stimuli. This tends to suggest that the critic part of the basal ganglia may be utilized for evaluating different actors whose origin are yet to be determined experimentally.
Document type :
Documents associated with scientific events
Liste complète des métadonnées

https://hal.inria.fr/hal-01418327
Contributor : Nicolas P. Rougier <>
Submitted on : Friday, December 16, 2016 - 3:55:53 PM
Last modification on : Thursday, January 11, 2018 - 6:25:42 AM
Document(s) archivé(s) le : Monday, March 27, 2017 - 11:40:25 PM

File

onecritic-twoactors-1611171726...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01418327, version 1

Citation

Nicolas P. Rougier. One critic for two actors. GT8 Robotiques et neurosciences, Nov 2016, Bordeaux, France. ⟨http://www.isir.upmc.fr/index.php?op=view_profil&lang=fr&id=109&pageid=1393⟩. ⟨hal-01418327⟩

Share

Metrics

Record views

305

Files downloads

53