A biologically inspired neuronal model of reward prediction error computation

Pramod Kaushik 1, 2 Maxime Carrere 2 Frédéric Alexandre 2 Surampudi Raju 1, 3
1 IIIT-H - International Institute of Information Technology, Hyderabad [Hyderabad]
2 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
3 Université d'Hyderabad
Abstract : The neurocomputational model described here proposes that two dimensions involved in computation of reward prediction errors i.e magnitude and time could be computed separately and later combined unlike traditional reinforcement learning models. The model is built on biological evidences and is able to reproduce various aspects of classical conditioning, namely, the progressive cancellation of the predicted reward, the predictive firing from conditioned stimuli, and delineation of early rewards by showing firing for sooner early rewards and not for early rewards that occur with a longer latency in accordance with biological data.
Document type :
Conference papers
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download
https://hal.inria.fr/hal-01528658
Contributor : Frédéric Alexandre <>
Submitted on : Monday, May 29, 2017 - 2:16:45 PM
Last modification on : Wednesday, February 7, 2018 - 10:17:48 AM
Long-term archiving on : Wednesday, September 6, 2017 - 11:04:52 AM

File

IJCNN2017_RPE_Model_0.6.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01528658, version 1

Collections

INRIA-BORDEAUX | UNIV-BORDEAUX | LABRI | INRIA | LABRI-MABIOVIS

Citation

Pramod Kaushik, Maxime Carrere, Frédéric Alexandre, Surampudi Raju. A biologically inspired neuronal model of reward prediction error computation. IJCNN 2017 - International Joint Conference on Neural Networks, May 2017, Anchorage, United States. pp.8. ⟨hal-01528658⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

546

Files downloads

252

Contact


archive-ouverte@inria.fr