Large-Scale Experiment of Co-allocation Strategies for Peer-to-Peer SuperComputing in P2P-MPI

Abstract : High Performance computing generally involves some parallel applications to be deployed on the multiples resources used for the computation. The problem of scheduling the application across distributed resources is termed co-allocation. In a grid context, co-allocation is difficult since the grid middleware must face a dynamic environment. Middleware architecture on a Peer-to-Peer (P2P) basis have been proposed to tackle most limitations of centralized systems. Some of the issues addressed by P2P systems are fault tolerance, ease of maintenance, and scalability in resource discovery. However, the lack of global knowledge makes scheduling difficult in P2P systems. In this paper, we present the new developments concerning locality awareness as well as co-allocation strategies available in the latest release of P2P-MPI. i) The 'spread' strategy tries to map processes on hosts so as to maximize the total amount of available memory while maintaining locality of processes as a secondary objective. ii) The 'concentrate' strategy tries to maximize locality between processes by using as many cores as hosts offer. The co-allocation scheme has been devised to be simple for the user and meets the main high performance computing requirement which is locality. Extensive experiments have been conducted on Grid5000 with up to 600 processes on 6 sites throughout France. Results show that we achieved the targeted goals in these real conditions.
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal.inria.fr/inria-00214137
Contributor : Stéphane Genaud <>
Submitted on : Wednesday, January 23, 2008 - 2:31:27 PM
Last modification on : Thursday, January 11, 2018 - 6:22:09 AM
Long-term archiving on : Thursday, April 15, 2010 - 1:41:48 AM

File

PID558522.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00214137, version 1

Collections

Citation

Stéphane Genaud, Choopan Rattanapoka. Large-Scale Experiment of Co-allocation Strategies for Peer-to-Peer SuperComputing in P2P-MPI. Fifth High-Performance Grid Computing Workshop in conjunction with 22nd IEEE International Parallel and Distributed Processing Symposium - IPDPS 2008, Apr 2008, Miami, United States. ⟨inria-00214137⟩

Share

Metrics

Record views

326

Files downloads

202