Skip to Main content Skip to Navigation
New interface
Conference papers

Controlling the Memory Subscription of Distributed Applications with a Task-Based Runtime System

Abstract : The ever-increasing supercomputer architectural complexity emphasizes the need for high-level parallel programming paradigms. Among such paradigms, task-based programming manages to abstract away much of the architecture complexity while efficiently meeting the performance challenge, even at large scale. Dynamic run-time systems are typically used to execute task-based applications, to schedule computation resource usage and memory allocations. While computation scheduling has been well studied, the dynamic management of memory resource subscription inside such run-times has however been little explored. This paper studies the cooperation between a task-based distributed application code and a run-time system engine to control the memory subscription levels throughout the execution. We show that the task paradigm allows to control the memory footprint of the application by throttling the task submission flow rate, striking a compromise between the performance benefits of anticipative task submission and the resulting memory consumption. We illustrate the benefits of our contribution on a compressed dense linear algebra distributed application.
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download
Contributor : Marc Sergent Connect in order to contact the contributor
Submitted on : Monday, March 7, 2016 - 11:38:26 AM
Last modification on : Saturday, June 25, 2022 - 7:44:16 PM
Long-term archiving on: : Sunday, November 13, 2016 - 8:07:22 AM


Files produced by the author(s)




Marc Sergent, David Goudin, Samuel Thibault, Olivier Aumage. Controlling the Memory Subscription of Distributed Applications with a Task-Based Runtime System. 21st International Workshop on High-Level Parallel Programming Models and Supportive Environments, May 2016, Chicago, United States. ⟨10.1109/IPDPSW.2016.105⟩. ⟨hal-01284004⟩



Record views


Files downloads