Skip to Main content Skip to Navigation
Journal articles

AutoParallel: Automatic parallelisation and distributed execution of affine loop nests in Python

Abstract : The last improvements in programming languages and models have focused on simplicity and abstraction; leading Python to the top of the list of the programming languages. However, there is still room for improvement when preventing users from dealing directly with distributed and parallel computing issues. This paper proposes and evaluates AutoParallel, a Python module to automatically find an appropriate task-based parallelisation of affine loop nests and execute them in parallel in a distributed computing infrastructure. It is based on sequential programming and contains one single annotation (in the form of a Python decorator) so that anyone with intermediate-level programming skills can scale up an application to hundreds of cores. The evaluation demonstrates that AutoParallel goes one step further in easing the development of distributed applications. On the one hand, the programmability evaluation highlights the benefits of using a single Python decorator instead of manually annotating each task and its parameters or, even worse, having to develop the parallel code explicitly (e.g., using OpenMP, MPI). On the other hand, the performance evaluation demonstrates that AutoParallel is capable of automatically generating task-based workflows from sequential Python code while achieving the same performances than manually taskified versions of established state-of-the-art algorithms (i.e., Cholesky, LU, and QR decompositions). Finally, AutoParallel is also capable of automatically building data blocks to increase the tasks' granularity; freeing the user from creating the data chunks, and redesigning the algorithm. For advanced users, we believe that this feature can be useful as a baseline to design blocked algorithms.
Document type :
Journal articles
Complete list of metadatas

Cited literature [48 references]  Display  Hide  Download

https://hal.inria.fr/hal-02971480
Contributor : Philippe Clauss <>
Submitted on : Monday, October 19, 2020 - 3:11:27 PM
Last modification on : Monday, November 16, 2020 - 10:20:07 AM

File

AutoParallel_IJHPCA.pdf
Files produced by the author(s)

Identifiers

Citation

Cristian Ramon-Cortes, Ramon Amela, Jorge Ejarque, Philippe Clauss, Rosa Badia. AutoParallel: Automatic parallelisation and distributed execution of affine loop nests in Python. International Journal of High Performance Computing Applications, SAGE Publications, 2020, 34 (6), pp.1 - 14. ⟨10.1177/1094342020937050⟩. ⟨hal-02971480⟩

Share

Metrics

Record views

30

Files downloads

57