Skip to Main content Skip to Navigation
Other publications

Characterizing Result Errors in Internet Desktop Grids

Derrick Kondo 1 Filipe Araujo 2 Paul Malecot 1 Patricio Domingues 3 Luis Moura Silva 2 Gilles Fedak 1 Franck Cappello 1
1 GRAND-LARGE - Global parallel and distributed computing
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LIFL - Laboratoire d'Informatique Fondamentale de Lille, LRI - Laboratoire de Recherche en Informatique
Abstract : Desktop grids use the free resources in Intranet and Internet environments for large-scale computation and storage. While desktop grids offer a high return on investment, one critical issue is the validation of results returned by participating hosts. Several mechanisms for result validation have been previously proposed. However, the characterization of errors is poorly understood. To study error rates, we implemented and deployed a desktop grid application across several thousand hosts distributed over the Internet. We then analyzed the results to give quantitative, empirical characterization of errors rates. We find that in practice, error rates are widespread across hosts but occur relatively infrequently. Moreover, we find that error rates tend to not be stationary over time nor correlated between hosts. In light of these characterization results, we evaluated state-of-the-art error detection mechanisms and describe the trade-offs for using each mechanism. Finally, based on our empirical results, we conduct a benefit analysis of a recently proposed mechanism for error detection tailored for long-running applications. This mechanism is based on using the digest of intermediate checkpoints, and we show in theory and simulation that the relative benefit of this method compared to the state-of-the-art is as high as 45\%.
Document type :
Other publications
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download

https://hal.inria.fr/inria-00102840
Contributor : Derrick Kondo <>
Submitted on : Monday, October 2, 2006 - 4:54:17 PM
Last modification on : Wednesday, September 16, 2020 - 5:04:10 PM
Long-term archiving on: : Monday, April 5, 2010 - 11:32:57 PM

Identifiers

  • HAL Id : inria-00102840, version 1

Collections

Citation

Derrick Kondo, Filipe Araujo, Paul Malecot, Patricio Domingues, Luis Moura Silva, et al.. Characterizing Result Errors in Internet Desktop Grids. 2006. ⟨inria-00102840⟩

Share

Metrics

Record views

867

Files downloads

678