A Visual Performance Analysis Framework for Task-based Parallel Applications running on Hybrid Clusters

Abstract : Programming paradigms in High-Performance Computing have been shifting towards task-based models which are capable of adapting readily to heterogeneous and scalable supercomputers. The performance of task-based application heavily depends on the runtime scheduling heuristics and on its ability to exploit computing and communication resources. Unfortunately, the traditional performance analysis strategies are unfit to fully understand task-based runtime systems and applications: they expect a regular behavior with communication and computation phases, while task-based applications demonstrate no clear phases. Moreover, the finer granularity of task-based applications typically induces a stochastic behavior that leads to irregular structures that are difficult to analyze. This paper details a flexible framework combining visualization panels to understand and pinpoint performance problems incurred by bad scheduling decisions in task-based applications. Three case-studies using StarPU-MPI, a task-based multi-node runtime system, are detailed to show how our framework is used to study the performance of the well-known Cholesky fac-torization. Performance improvements include a better task partitioning among the multi-(GPU,core) to get closer to theoretical lower bounds, improved MPI pipelin-ing in multi-(node,core,GPU) to reduce the slow start, and changes in the runtime system to increase MPI bandwidth, with gains of up to 13% in the total makespan.
Complete list of metadatas

Cited literature [46 references]  Display  Hide  Download

https://hal.inria.fr/hal-01616632
Contributor : Arnaud Legrand <>
Submitted on : Thursday, October 19, 2017 - 3:01:43 PM
Last modification on : Wednesday, November 14, 2018 - 8:40:26 AM
Long-term archiving on : Saturday, January 20, 2018 - 1:15:48 PM

File

CCPE_article_submitted_2017_09...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01616632, version 1

Collections

Citation

Vinicius Garcia Pinto, Lucas Schnorr, Luka Stanisic, Arnaud Legrand, Samuel Thibault, et al.. A Visual Performance Analysis Framework for Task-based Parallel Applications running on Hybrid Clusters. 2017. ⟨hal-01616632v1⟩

Share

Metrics

Record views

679

Files downloads

228