Controlling the Memory Subscription of Distributed Applications with a Task-Based Runtime System

Abstract : The ever-increasing supercomputer architectural complexity emphasizes the need for high-level parallel programming paradigms. Among such paradigms, task-based programming manages to abstract away much of the architecture complexity while efficiently meeting the performance challenge, even at large scale. Dynamic run-time systems are typically used to execute task-based applications, to schedule computation resource usage and memory allocations. While computation scheduling has been well studied, the dynamic management of memory resource subscription inside such run-times has however been little explored. This paper studies the cooperation between a task-based distributed application code and a run-time system engine to control the memory subscription levels throughout the execution. We show that the task paradigm allows to control the memory footprint of the application by throttling the task submission flow rate, striking a compromise between the performance benefits of anticipative task submission and the resulting memory consumption. We illustrate the benefits of our contribution on a compressed dense linear algebra distributed application.
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download

https://hal.inria.fr/hal-01284004
Contributor : Marc Sergent <>
Submitted on : Monday, March 7, 2016 - 11:38:26 AM
Last modification on : Tuesday, May 14, 2019 - 11:38:08 AM
Long-term archiving on : Sunday, November 13, 2016 - 8:07:22 AM

File

PID4127657.pdf
Files produced by the author(s)

Identifiers

Citation

Marc Sergent, David Goudin, Samuel Thibault, Olivier Aumage. Controlling the Memory Subscription of Distributed Applications with a Task-Based Runtime System. 21st International Workshop on High-Level Parallel Programming Models and Supportive Environments, May 2016, Chicago, United States. ⟨10.1109/IPDPSW.2016.105⟩. ⟨hal-01284004⟩

Share

Metrics

Record views

572

Files downloads

441