HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

An Efficient Network API for in-Kernel Applications in Clusters

Brice Goglin 1, 2 Olivier Glück 2, 1 Pascale Vicat-Blanc Primet 1, 2
2 RESO - Protocols and softwares for very high-performance network
Inria Grenoble - Rhône-Alpes, ENS Lyon - École normale supérieure - Lyon, CNRS - Centre National de la Recherche Scientifique : UMR5668
Abstract : Running parallel applications on clusters with high-speed local networks requires fast communication between computing nodes but also low latency and high bandwidth file access. However, the application programming interfaces of high-speed local networks were designed for MPI communication and do not always meet the requirements of other applications like distributed file systems. In this paper, we explore several solutions to improve the use of high-speed network for in-kernel applications. Distributed file systems implemented on top of the GM interface of Myrinet are first examined to demonstrate how hard it is to get an efficient interaction between such applications and the network. Then, we propose solutions to simplify and improve this interaction and integrate them into the kernel interface of the new Myrinet. Performance comparisons between MX and GM, and their usage in both a distributed file system and a zero-copy protocol show nice improvements. Moreover, we are able to improve the performance of the flexible kernel API we designed in MX that allows to remove some intermediate copy.
Document type :
Conference papers
Complete list of metadata

Cited literature [15 references]  Display  Hide  Download

Contributor : Brice Goglin Connect in order to contact the contributor
Submitted on : Friday, May 19, 2006 - 8:30:37 PM
Last modification on : Friday, February 4, 2022 - 3:19:28 AM
Long-term archiving on: : Sunday, April 4, 2010 - 8:02:25 PM




Brice Goglin, Olivier Glück, Pascale Vicat-Blanc Primet. An Efficient Network API for in-Kernel Applications in Clusters. International Conference on Cluster Computing, Sep 2005, Boston, United States. pp.18, ⟨10.1109/CLUSTR.2005.347044⟩. ⟨inria-00070445⟩



Record views


Files downloads