A Model for Space-Correlated Failures in Large-Scale Distributed Systems

Matthieu Gallet 1, 2, 3, * Nezih Yigitbasi 3 Bahman Javadi 4 Derrick Kondo 4, * Alexandru Iosup 3 Dick Epema 3
* Corresponding author
2 GRAAL - Algorithms and Scheduling for Distributed Heterogeneous Platforms
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
4 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : Distributed systems such as grids, peer-to-peer systems, and even Internet DNS servers have grown significantly in size and complexity in the last decade. This rapid growth has allowed distributed systems to serve a large and increasing number of users, but has also made resource and system failures inevitable. Moreover, perhaps as a result of system complexity, in distributed systems a single failure can trigger within a short time span several more failures, forming a group of time-correlated failures. To eliminate or alleviate the significant effects of failures on performance and functionality, the techniques for dealing with failures require good failure models. However, not many such models are available, and the available models are valid for few or even a single distributed system. In contrast, in this work we propose a model that considers groups of time-correlated failures and is valid for many types of distributed systems. Our model includes three components, the group size, the group inter-arrival time, and the resource downtime caused by the group. To validate this model, we use failure traces corresponding to fifteen distributed systems. We find that space-correlated failures are dominant in terms of resource downtime in seven of the fifteen studied systems. For each of these seven systems, we provide a set of model parameters that can be used in research studies or for tuning distributed systems. Last, as a result of our work six of the studied traces have been made available through the Failure Trace Archive (http://fta.inria.fr).
Document type :
Conference papers
Liste complète des métadonnées

Contributor : Equipe Roma <>
Submitted on : Friday, February 8, 2013 - 11:36:12 AM
Last modification on : Thursday, October 11, 2018 - 8:48:02 AM


  • HAL Id : hal-00786268, version 1



Matthieu Gallet, Nezih Yigitbasi, Bahman Javadi, Derrick Kondo, Alexandru Iosup, et al.. A Model for Space-Correlated Failures in Large-Scale Distributed Systems. Euro-Par 2010 - Proceedings of the 16th International Euro-Par Conference, 2010, Ischia, Italy. 168-179, x-pays = NL. ⟨hal-00786268⟩



Record views