Controlling and Scheduling Parallel I/O in Multi-application Environments

Adrien Lebre 1 Yves Denneulin 2 Thanh Trung Van 2
1 MESCAL - Middleware efficiently scalable
ID-IMAG - Informatique et Distribution, Inria Grenoble - Rhône-Alpes
2 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : As clusters usage grows, a lot of scientific applications (biology, climatology, nuclear physics ...) have undergone rewrites to harness the extra CPU and extra storage provided. These demanding software, besides handling huge amounts of data with peculiar parallel I/O access patterns, are run on clusters, environments where concurrency between those applications occurs. Several propositions have been made to manage both the intensive parallel I/O applications and the cluster constraints. Nevertheless, available Parallel File Systems or Parallel I/O Libraries are based on specific API's, which limit portability and require good knowledge of their internal mechanisms to get good performances. Moreover, Parallel I/O Libraries are usually focused on running only one application without taking into account the load that the other ones generate on the cluster. This paper presents a new strategy to handle parallel I/O in a multi-application and distributed environment. Our framework detects parallel I/O accesses without inter-processes synchronization mechanisms and uses a simple interface based on the classic UNIX system calls (creat/open/read/write/close). In addition, we analyze two scheduling strategies to improve global performances and provide fairness between applications. Early experiments have given promising results and have shown that using such approaches may lead to better performances as well as improvements of quality of service.
Type de document :
Rapport
[Research Report] RR-5689, INRIA. 2005, pp.19
Liste complète des métadonnées

https://hal.inria.fr/inria-00070324
Contributeur : Rapport de Recherche Inria <>
Soumis le : vendredi 19 mai 2006 - 20:07:02
Dernière modification le : mardi 4 décembre 2018 - 09:36:02
Document(s) archivé(s) le : dimanche 4 avril 2010 - 20:56:46

Fichiers

Identifiants

  • HAL Id : inria-00070324, version 1

Collections

Citation

Adrien Lebre, Yves Denneulin, Thanh Trung Van. Controlling and Scheduling Parallel I/O in Multi-application Environments. [Research Report] RR-5689, INRIA. 2005, pp.19. 〈inria-00070324〉

Partager

Métriques

Consultations de la notice

314

Téléchargements de fichiers

258