Scalable Multi-Purpose Network Representation for Large Scale Distributed System Simulation

Laurent Bobelin 1 Arnaud Legrand 1, 2 Márquez David 3 Pierre Navarro 1 Martin Quinson 3 Frédéric Suter 4 Christophe Thiery 3
1 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
3 ALGORILLE - Algorithms for the Grid
INRIA Nancy - Grand Est, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Conducting experiments in large-scale distributed systems is usually time-consuming and labor-intensive. Uncontrolled external load variation prevents to reproduce experiments and such systems are often not available to the purpose of research experiments, e.g., production or yet to deploy systems. Hence, many researchers in the area of distributed computing rely on simulation to perform their studies. However, the simulation of large-scale computing systems raises several scalability issues, in terms of speed and memory. Indeed, such systems now comprise millions of hosts interconnected through a complex network and run billions of processes. Hence, most simulators trade accuracy for speed and rely on very simple and easy to implement models. However, the assumptions underlying these models are often questionable, especially when it comes to network modeling. In this paper, we show that, despite a widespread belief in the community, achieving high scalability does not necessarily require to resort to overly simple models and ignore important phenomena. We show that relying on a modular and hierarchical platform representation, while taking advantage of regularity when possible, allows us to model systems such as data and computing centers, peer-to-peer networks, grids, or clouds in a scalable way. This approach has been integrated into the open-source SimGrid simulation toolkit. We show that our solution allows us to model such systems much more accurately than other state-of-the-art simulators without trading for simulation speed. SimGrid is even sometimes orders of magnitude faster.
Document type :
Conference papers
CCGrid 2012 -- The 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2012, Ottawa, Canada. pp.19, 2012


https://hal.inria.fr/hal-00650233
Contributor : Martin Quinson <>
Submitted on : Tuesday, June 5, 2012 - 8:56:06 AM
Last modification on : Monday, March 2, 2015 - 3:04:48 PM

Identifiers

  • HAL Id : hal-00650233, version 2

Collections

Citation

Laurent Bobelin, Arnaud Legrand, Márquez David, Pierre Navarro, Martin Quinson, et al.. Scalable Multi-Purpose Network Representation for Large Scale Distributed System Simulation. CCGrid 2012 -- The 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2012, Ottawa, Canada. pp.19, 2012. <hal-00650233v2>

Export

Share

Metrics

Consultation de
la notice

711

Téléchargement du document

365