AutoParallel: Automatic parallelisation and distributed execution of affine loop nests in Python - Archive ouverte HAL Access content directly
Journal Articles International Journal of High Performance Computing Applications Year : 2020

AutoParallel: Automatic parallelisation and distributed execution of affine loop nests in Python

(1) , (1) , (1) , (2, 3) , (1)
1
2
3

Abstract

The last improvements in programming languages and models have focused on simplicity and abstraction; leading Python to the top of the list of the programming languages. However, there is still room for improvement when preventing users from dealing directly with distributed and parallel computing issues. This paper proposes and evaluates AutoParallel, a Python module to automatically find an appropriate task-based parallelisation of affine loop nests and execute them in parallel in a distributed computing infrastructure. It is based on sequential programming and contains one single annotation (in the form of a Python decorator) so that anyone with intermediate-level programming skills can scale up an application to hundreds of cores. The evaluation demonstrates that AutoParallel goes one step further in easing the development of distributed applications. On the one hand, the programmability evaluation highlights the benefits of using a single Python decorator instead of manually annotating each task and its parameters or, even worse, having to develop the parallel code explicitly (e.g., using OpenMP, MPI). On the other hand, the performance evaluation demonstrates that AutoParallel is capable of automatically generating task-based workflows from sequential Python code while achieving the same performances than manually taskified versions of established state-of-the-art algorithms (i.e., Cholesky, LU, and QR decompositions). Finally, AutoParallel is also capable of automatically building data blocks to increase the tasks' granularity; freeing the user from creating the data chunks, and redesigning the algorithm. For advanced users, we believe that this feature can be useful as a baseline to design blocked algorithms.
Fichier principal
Vignette du fichier
AutoParallel_IJHPCA.pdf (922.5 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02971480 , version 1 (19-10-2020)

Identifiers

Cite

Cristian Ramon-Cortes, Ramon Amela, Jorge Ejarque, Philippe Clauss, Rosa M Badia. AutoParallel: Automatic parallelisation and distributed execution of affine loop nests in Python. International Journal of High Performance Computing Applications, 2020, 34 (6), pp.1 - 14. ⟨10.1177/1094342020937050⟩. ⟨hal-02971480⟩
80 View
203 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More