Task-based Conjugate Gradient: from multi-GPU towards heterogeneous architectures

Emmanuel Agullo 1 Luc Giraud 1 Abdou Guermouche 2 Stojce Nakov 1 Jean Roman 1
1 HiePACS - High-End Parallel Algorithms for Challenging Numerical Simulations
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
Abstract : Whereas most parallel High Performance Computing (HPC) numerical libaries have been written as highly tuned and mostly monolithic codes, the increased complexity of modern architectures led the computational science and engineering community to consider more modular programming paradigms such as task-based paradigms to design new generation of parallel simulation code; this enables to delegate part of the work to a third party software such as a runtime system. That latter approach has been shown to be very productive and efficient with compute-intensive algorithms, such as dense linear algebra and sparse direct solvers. In this study, we consider a much more irregular, and synchronizing algorithm, namely the Conjugate Gradient (CG) algorithm. We propose a task-based formulation of the algorithm together with a very fine instrumentation of the runtime system. We show that almost optimum speed up may be reached on a multi-GPU platform (relatively to the mono-GPU case) and, as a very preliminary but promising result, that the approach can be effectively used to handle heterogenous architectures composed of a multicore chip and multiple GPUs. We expect that these results will pave the way for investigating the design of new advanced, irregular numerical algorithms on top of runtime systems.
Type de document :
Communication dans un congrès
HeteroPar'2016 worshop of Euro-Par, Aug 2016, Grenoble, France. Lecture Note in Computer Science, Euro-Par 2016: Parallel Processing Workshops. <http://www.ens-lyon.fr/LIP/ROMA/HeteroPar2016/>. <10.1007/978-3-319-58943-5>
Liste complète des métadonnées

https://hal.inria.fr/hal-01334734
Contributeur : Luc Giraud <>
Soumis le : mardi 21 juin 2016 - 11:43:29
Dernière modification le : mardi 27 juin 2017 - 01:13:44

Identifiants

Collections

Citation

Emmanuel Agullo, Luc Giraud, Abdou Guermouche, Stojce Nakov, Jean Roman. Task-based Conjugate Gradient: from multi-GPU towards heterogeneous architectures. HeteroPar'2016 worshop of Euro-Par, Aug 2016, Grenoble, France. Lecture Note in Computer Science, Euro-Par 2016: Parallel Processing Workshops. <http://www.ens-lyon.fr/LIP/ROMA/HeteroPar2016/>. <10.1007/978-3-319-58943-5>. <hal-01334734>

Partager

Métriques

Consultations de la notice

199