Computing the throughput of probabilistic and replicated streaming applications

Anne Benoit 1 Matthieu Gallet 1, * Bruno Gaujal 2 Yves Robert 1, 3
* Auteur correspondant
2 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
3 ROMA - Optimisation des ressources : modèles, algorithmes et ordonnancement
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : In this paper, we investigate how to compute the throughput of probabilistic and replicated streaming applications. We are given (i) a streaming application whose dependence graph is a linear chain; (ii) a one-to-many mapping of the application onto a fully heterogeneous target platform, where a processor is assigned at most one application stage, but where a stage can be replicated onto a set of processors; and (iii) a set of random variables modeling the computation and communication times in the mapping. We show how to compute the throughput of the application, i.e., the rate at which data sets can be processed, under two execution models, the Strict model where the actions of each processor are sequentialized, and the Overlap model where a processor can compute and communicate in parallel. The problem is easy when application stages are not replicated, i.e., assigned to a single processor: in that case the throughput is dictated by the critical hardware resource. However, when stages are replicated, i.e., assigned to several processors, the problem becomes surprisingly complicated: even in the deterministic case, the optimal throughput may be lower than the smallest internal resource throughput. The first contribution of the paper is to provide a general method to compute the throughput when mapping parameters are constant or follow I.I.D. exponential laws. The second contribution is to provide bounds for the throughput when stage parameters (computation and communication times) form associated random sequences, and are N.B.U.E. (New Better than Used in Expectation) variables: the throughput is bounded from below by the exponential case and bounded from above by the deterministic case. An extensive set of simulation allows us to assess the quality of the model, and to observe the actual behavior of several distributions.
Type de document :
Article dans une revue
Algorithmica, Springer Verlag, 2013, 69 (4), pp.925-957
Liste complète des métadonnées

https://hal.inria.fr/hal-00800083
Contributeur : Bruno Gaujal <>
Soumis le : mercredi 13 mars 2013 - 10:44:36
Dernière modification le : vendredi 19 août 2016 - 01:04:55
Document(s) archivé(s) le : lundi 17 juin 2013 - 12:37:09

Fichier

algorithmica.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00800083, version 1

Collections

Citation

Anne Benoit, Matthieu Gallet, Bruno Gaujal, Yves Robert. Computing the throughput of probabilistic and replicated streaming applications. Algorithmica, Springer Verlag, 2013, 69 (4), pp.925-957. <hal-00800083>

Partager

Métriques

Consultations de
la notice

248

Téléchargements du document

139