Enabling user-driven Checkpointing strategies in Reverse-mode Automatic Differentiation

Laurent Hascoet 1 Mauricio Araya-Polo 1
1 TROPICS - Program transformations for scientific computing
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : This paper presents a new functionality of the Automatic Differentiation (AD) tool Tapenade. Tapenade generates adjoint codes which are widely used for optimization or inverse problems. Unfortunately, for large applications the adjoint code demands a great deal of memory, because it needs to store a large set of intermediates values. To cope with that problem, Tapenade implements a sub-optimal version of a technique called checkpointing, which is a trade-off between storage and recomputation. Our long-term goal is to provide an optimal checkpointing strategy for every code, not yet achieved by any AD tool. Towards that goal, we first introduce modifications in Tapenade in order to give the user the choice to select the checkpointing strategy most suitable for their code. Second, we conduct experiments in real-size scientific codes in order to gather hints that help us to deduce an optimal checkpointing strategy. Some of the experimental results show memory savings up to 35% and execution time up to 90%.
Type de document :
Rapport
[Research Report] RR-5930, INRIA. 2006, pp.21
Liste complète des métadonnées

Littérature citée [1 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00079223
Contributeur : Rapport de Recherche Inria <>
Soumis le : lundi 12 juin 2006 - 10:54:05
Dernière modification le : samedi 27 janvier 2018 - 01:31:24
Document(s) archivé(s) le : lundi 20 septembre 2010 - 15:44:32

Identifiants

Collections

Citation

Laurent Hascoet, Mauricio Araya-Polo. Enabling user-driven Checkpointing strategies in Reverse-mode Automatic Differentiation. [Research Report] RR-5930, INRIA. 2006, pp.21. 〈inria-00079223v2〉

Partager

Métriques

Consultations de la notice

134

Téléchargements de fichiers

119