Skip to Main content Skip to Navigation
Conference papers

Collaborative Data Distribution with BitTorrent for Computational Desktop Grids

Baohua Wei 1, 2 Gilles Fedak 1, 2 Franck Cappello 1, 2
1 GRAND-LARGE - Global parallel and distributed computing
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LIFL - Laboratoire d'Informatique Fondamentale de Lille, LRI - Laboratoire de Recherche en Informatique
Abstract : Data-centric applications are still a challenging issue for Large Scale Distributed Computing Systems. The emergence of new protocols and softwares for collaborative content distribution over Internet offers a new opportunity for efficient and fast delivery of high volume of data. This paper presents an evaluation of the BitTorrent protocol for Computational Desktop Grids. We first present a prototype of a generic subsystem dedicated to data management and designed to serve as a building block for any Desktop Grid System. Based on this prototype we conduct experimentations to evaluate the potential of BitTorrent compared to a classical approach based on FTP data server. The preliminary results obtained with a 65-nodes cluster measure the basic characteristics of BitTorrent in terms of latency and bandwidth and evaluate the scalability of BitTorrent for the delivery of large input files. Moreover, we show that BitTorrent has a considerable latency overhead compared to FTP but clearly outperforms FTP when distributing large files or files to a high number of nodes. Tests on a synthetic application show that BitTorrent significantly increases the communication/computation ratio of the applications eligible to run on a Desktop Grid System.
Complete list of metadata

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/inria-00001041
Contributor : Gilles Fedak <>
Submitted on : Thursday, January 19, 2006 - 11:08:19 AM
Last modification on : Wednesday, October 14, 2020 - 3:41:42 AM
Long-term archiving on: : Saturday, April 3, 2010 - 9:33:49 PM

Identifiers

  • HAL Id : inria-00001041, version 1

Collections

Citation

Baohua Wei, Gilles Fedak, Franck Cappello. Collaborative Data Distribution with BitTorrent for Computational Desktop Grids. International Symposium on Parallel and Distributed Computing (ISPDC’2005), Jul 2005, Lille/France. ⟨inria-00001041⟩

Share

Metrics

Record views

513

Files downloads

1036