Hierarchical Memory Management for Parallel Programs

Abstract : An important feature of functional programs is that they are parallel by default. Implementing an efficient parallel functional language, however, is a major challenge, in part because the high rate of allocation and freeing associated with functional programs requires an efficient and scalable memory manager. In this paper, we present a technique for parallel memory management for strict functional languages with nested parallelism. At the highest level of abstraction, the approach consists of a technique to organize memory as a hierarchy of heaps, and an algorithm for performing automatic memory reclamation by taking advantage of a disentanglement property of parallel functional programs. More specifically, the idea is to assign to each parallel task its own heap in memory and organize the heaps in a hierarchy/tree that mirrors the hierarchy of tasks. We present a nested-parallel calculus that specifies hierarchical heaps and prove in this calculus a disentanglement property, which prohibits a task from accessing objects allocated by another task that might execute in parallel. Leveraging the disentanglement property, we present a garbage collection technique that can operate on any subtree in the memory hierarchy concurrently as other tasks (and/or other collections) proceed in parallel. We prove the safety of this collector by formalizing it in the context of our parallel calculus. In addition, we describe how the proposed techniques can be implemented on modern shared-memory machines and present a prototype implementation as an extension to MLton, a high-performance compiler for the Standard ML language. Finally, we evaluate the performance of this implementation on a number of parallel benchmarks.
Type de document :
Communication dans un congrès
Proceedings of the 21st ACM SIGPLAN International Conference on Functional Programming, Sep 2016, Nara, Japan. <10.1145/3022670.2951935>
Liste complète des métadonnées

Contributeur : Arthur Charguéraud <>
Soumis le : mercredi 14 décembre 2016 - 11:14:09
Dernière modification le : jeudi 15 décembre 2016 - 01:06:15
Document(s) archivé(s) le : mercredi 15 mars 2017 - 13:28:09


Fichiers produits par l'(les) auteur(s)




Ram Raghunathan, Stefan Muller, Umut Acar, Guy Blelloch. Hierarchical Memory Management for Parallel Programs. Proceedings of the 21st ACM SIGPLAN International Conference on Functional Programming, Sep 2016, Nara, Japan. <10.1145/3022670.2951935>. <hal-01416237>



Consultations de
la notice


Téléchargements du document