Visual Performance Analysis of Memory Behavior in a Task-Based Runtime on Hybrid Platforms

Abstract : Programming parallel applications for heterogeneous HPC platforms is much more straightforward when using the task-based programming paradigm. The simplicity exists because a runtime takes care of many activities usually carried out by the application developer, such as task mapping, load balancing, and memory management operations. In this paper, we present a visualization-based performance analysis methodology to investigate the CPU-GPU-Disk memory management of the StarPU runtime, a popular task-based middleware for HPC applications. We detail the design of novel graphical strategies that were fundamental to recognize performance problems in four study cases. We first identify poor management of data handles when GPU memory is saturated, leading to low application performance. Our experiments using the dense tiled-based Cholesky factorization show that our fix leads to performance gains of 66% and better scalability for larger input sizes. In the other three cases, we study scenarios where the main memory is insufficient to store all the application's data, forcing the runtime to store data out-of-core. Using our methodology, we pinpoint different behavior among schedulers and how we have identified a crucial problem in the application code regarding initial block placement, which leads to poor performance.
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download

https://hal.inria.fr/hal-02275363
Contributor : Samuel Thibault <>
Submitted on : Friday, August 30, 2019 - 4:22:51 PM
Last modification on : Tuesday, September 3, 2019 - 9:23:25 AM

File

CCGRID_camera_ready.pdf
Files produced by the author(s)

Identifiers

Citation

Lucas Leandro Nesi, Samuel Thibault, Luka Stanisic, Lucas Mello Schnorr. Visual Performance Analysis of Memory Behavior in a Task-Based Runtime on Hybrid Platforms. CCGrid 2019 - 19thAnnual IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2019, Larnaca, Cyprus. pp.142-151, ⟨10.1109/CCGRID.2019.00025⟩. ⟨hal-02275363⟩

Share

Metrics

Record views

143

Files downloads

364