Scalable Multi-Purpose Network Representation for Large Scale Distributed System Simulation

Laurent Bobelin 1 Arnaud Legrand 1, 2 Márquez David 3 Pierre Navarro 1 Martin Quinson 3 Frédéric Suter 4 Christophe Thiery 3
1 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
3 ALGORILLE - Algorithms for the Grid
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Conducting experiments in large-scale distributed systems is usually time-consuming and labor-intensive. Uncontrolled external load variation prevents to reproduce experiments and such systems are often not available to the purpose of research experiments, e.g., production or yet to deploy systems. Hence, many researchers in the area of distributed computing rely on simulation to perform their studies. However, the simulation of large-scale computing systems raises several scalability issues, in terms of speed and memory. Indeed, such systems now comprise millions of hosts interconnected through a complex network and run billions of processes. Hence, most simulators trade accuracy for speed and rely on very simple and easy to implement models. However, the assumptions underlying these models are often questionable, especially when it comes to network modeling. In this paper, we show that, despite a widespread belief in the community, achieving high scalability does not necessarily require to resort to overly simple models and ignore important phenomena. We show that relying on a modular and hierarchical platform representation, while taking advantage of regularity when possible, allows us to model systems such as data and computing centers, peer-to-peer networks, grids, or clouds in a scalable way. This approach has been integrated into the open-source SimGrid simulation toolkit. We show that our solution allows us to model such systems much more accurately than other state-of-the-art simulators without trading for simulation speed. SimGrid is even sometimes orders of magnitude faster.
Complete list of metadatas
Contributor : Arnaud Legrand <>
Submitted on : Friday, December 9, 2011 - 3:44:06 PM
Last modification on : Friday, April 19, 2019 - 3:24:48 PM
Long-term archiving on : Friday, November 16, 2012 - 3:05:08 PM


Files produced by the author(s)


  • HAL Id : hal-00650233, version 1



Laurent Bobelin, Arnaud Legrand, Márquez David, Pierre Navarro, Martin Quinson, et al.. Scalable Multi-Purpose Network Representation for Large Scale Distributed System Simulation. CCGrid 2012 -- The 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2012, Ottawa, Canada. pp.19. ⟨hal-00650233v1⟩



Record views


Files downloads