Defining metrics for multicore throughput on multiprogrammed workloads

Abstract : Measuring throughput is not as straightforward as measuring execution time. This has led to an ongoing debate on what forms a meaningful throughput metric for multi-program workloads. We present a method to construct throughput metrics in a systematic way: we start by expressing assumptions on job size, job distribution, scheduling, etc., that together define a theoretical throughput experiment. The throughput metric is then the average throughput of this experiment. Different assumptions lead to different metrics, so one should select the metric whose assumptions are close to the real usage he/she has in mind. We elaborate multiple metrics based on different assumptions. In particular, we identify the assumptions that lead to the commonly used weighted speedup and harmonic mean of speedups. Our study clarifies that they are actual throughput metrics, which was recently questioned. We also propose some new throughput metrics, whose calculation sometimes requires approximation. We use synthetic and real experimental data to characterize metrics and show how they relate to each other. Our study can also serve as a starting point if one needs to define a new metric based on specific assumptions, other than the ones we consider in this study. Throughput metrics should always be defined from explicit assumptions, because this leads to a better understanding of the implications and limits of the results obtained with that metric.
Type de document :
Rapport
[Research Report] RR-8401, INRIA. 2013
Liste complète des métadonnées

Littérature citée [1 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00908864
Contributeur : Pierre Michaud <>
Soumis le : lundi 25 novembre 2013 - 14:08:55
Dernière modification le : vendredi 16 novembre 2018 - 01:39:34
Document(s) archivé(s) le : lundi 3 mars 2014 - 15:00:44

Fichier

RR-8401.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00908864, version 1

Citation

Stijn Eyerman, Pierre Michaud. Defining metrics for multicore throughput on multiprogrammed workloads. [Research Report] RR-8401, INRIA. 2013. 〈hal-00908864〉

Partager

Métriques

Consultations de la notice

615

Téléchargements de fichiers

197