What is computational reproducibility?

Olivia Guest 1 Nicolas P. Rougier 2, 3, 4
2 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : Computational modelling is the process by which phenomena found in complex systems are expressed algorithmically. The creation of such simulations is useful because it allows us to test whether our understanding is sophisticated enough to create credible working models of the phenomena we are studying. In neuroscience and cognitive science especially, computational modelling comprises more than just capturing a single phenomenon, it also implements a theory. It gives scientists a method of allowing their ideas to be executed, i.e., for emergent properties to appear when they are implemented and run (McClelland, 2009). In this context, a model is said to be replicable if experiments within it can be carried out successfully using the original codebase, with the implicit assumption that such a codebase is available. However, for models to be evaluated it is mandatory to ensure they are reproducible (Topalidou, Leblois, Boraud, & Rougier, 2015). That is, that they can be recreated based on their specification — the details deemed important enough to be included in the accompanying article (Hinsen, 2015). Ideally, this should be possible without contacting the authors for advice, and critically, without referring to the original code (Cooper & Guest, 2014). If the specification is sufficient to successfully recreate the codebase from scratch, then the model is said to be reproducible. This adds further credence to both the model and its overarching theoretical framework. If not, and the model cannot be recreated, then even if the experiments can be carried out successfully within the original codebase, the model is not reproducible (Crook, Davison, & Plesser, 2013). How to share computational research?
Type de document :
Article dans une revue
IEEE CDS Newsletter, IEEE CIS, 2016, 13 (1)
Liste complète des métadonnées

Littérature citée [8 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01358082
Contributeur : Nicolas P. Rougier <>
Soumis le : mercredi 31 août 2016 - 08:51:10
Dernière modification le : jeudi 11 janvier 2018 - 06:25:42
Document(s) archivé(s) le : vendredi 2 décembre 2016 - 01:58:30

Fichier

guest_rougier_2016.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01358082, version 1

Citation

Olivia Guest, Nicolas P. Rougier. What is computational reproducibility?. IEEE CDS Newsletter, IEEE CIS, 2016, 13 (1). 〈hal-01358082〉

Partager

Métriques

Consultations de la notice

375

Téléchargements de fichiers

172