A Simple Reservoir Model of Working Memory with Real Values

Anthony Strock 1 Nicolas P. Rougier 1 Xavier Hinaut 1
1 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : Prefrontal cortex is known to be involved in many high-level cognitive functions, in particular working memory. Here, we study to what extent a group of randomly connected units can store and maintain (as output) an arbitrary real value from a streamed input, i.e. how such system act as a sustained working memory module without being distracted by the input stream. Furthermore, we explore to what extent such an architecture can take advantage of the stored value in order to produce non-linear computations. Systematic comparison between different architectures (with and without feedback, with and without a working memory unit) shows that explicit memory is required. With Principal Component Analyses (PCA) we show that the reservoir state is encoding time and the memorized value in different ways depending if a supplementary task is required. Moreover, theses memory states are similar to attractors in an input-driven system [3], and in particular, similar to a noisy line attractor [6]. In this study, we did not try to find the optimal number of reservoir units needed for each task. Conversely, we voluntary limited the size of the reservoir to 100 neurons in order to see if such rather small reservoirs were sufficiently competitive.
Document type :
Poster communications
Complete list of metadatas

https://hal.inria.fr/hal-01861784
Contributor : Nicolas P. Rougier <>
Submitted on : Saturday, August 25, 2018 - 1:06:20 PM
Last modification on : Friday, May 10, 2019 - 5:31:14 PM
Long-term archiving on : Monday, November 26, 2018 - 1:27:41 PM

File

2018-06_ws_theo-neuro_Goetting...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01861784, version 1

Citation

Anthony Strock, Nicolas P. Rougier, Xavier Hinaut. A Simple Reservoir Model of Working Memory with Real Values. Third workshop on advanced methods in theoretical neuroscience, Jun 2018, Göttingen, Germany. ⟨hal-01861784⟩

Share

Metrics

Record views

86

Files downloads

240