Skip to Main content Skip to Navigation
Documents associated with scientific events

One critic for two actors

Nicolas P. Rougier 1, 2, 3 
3 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : We introduces a new hypothesis concerning the dissociated role of the basal ganglia in the selection and the evaluation of action that has been formulated using a theoretical model and confirmed experimentally in monkeys. To do so, and prior to learning, we inactivated the internal part of the Globus Pallidus (GPi, the main output structure of the BG) with injections of Muscimol and we tested monkeys on a variant of a two-armed bandit task where two stimuli are associated with two distinct reward probabilities (0.25 and 0.75 respectively). Unsurprisingly, performance in such condition are at the chance level since the output of basal ganglia cannot influence behaviour. However, the theoretical model predicts that in the meantime, values of the stimuli are nonetheless covertly evaluated and learned. This has been tested and confirmed on the next day, when inhibition has been removed: monkeys instantly showed significant improved performances (above chance level), hence demonstrating they have learned and knew the relative value of the two stimuli. This tends to suggest that the critic part of the basal ganglia may be utilized for evaluating different actors whose origin are yet to be determined experimentally.
Document type :
Documents associated with scientific events
Complete list of metadata
Contributor : Nicolas P. Rougier Connect in order to contact the contributor
Submitted on : Friday, December 16, 2016 - 3:55:53 PM
Last modification on : Saturday, June 25, 2022 - 7:47:18 PM
Long-term archiving on: : Monday, March 27, 2017 - 11:40:25 PM


Files produced by the author(s)


  • HAL Id : hal-01418327, version 1



Nicolas P. Rougier. One critic for two actors. GT8 Robotiques et neurosciences, Nov 2016, Bordeaux, France. ⟨hal-01418327⟩



Record views


Files downloads