Going beyond mean and median programs performances

Julien Worms 1 Sid Touati 2, 3
2 AOSTE - Models and methods of analysis and optimization for systems with real-time and embedding constraints
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - COMRED - COMmunications, Réseaux, systèmes Embarqués et Distribués, Inria de Paris
Abstract : In the area of code performance optimisation and tuning, we are faced on the difficult problem of selecting the " best " code version based on empirical experiments and statistical analysis. With the massive introduction of general purpose multicore processors, programs performances become more and more instable, especially parallel programs. Usual statistical methods for computing performance speedups and comparing between programs are based on testing mean or median values. In this article, we explain why these metrics may be inadequate for making relevent decisions, and we propose new performance metrics based on parametric statistics using gaussian mixture models. Our new statistical methods are more accurate for decision making, they are formally defined, computed, implemented and distributed as free software in [1].
Complete list of metadatas

Cited literature [11 references]  Display  Hide  Download

https://hal.inria.fr/hal-01371467
Contributor : Sid Touati <>
Submitted on : Monday, September 26, 2016 - 9:36:44 AM
Last modification on : Thursday, February 7, 2019 - 4:44:45 PM
Long-term archiving on : Tuesday, December 27, 2016 - 12:20:49 PM

File

MCSoC-16-Worms-Touati.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01371467, version 1

Citation

Julien Worms, Sid Touati. Going beyond mean and median programs performances. IEEE MCSoC 2016 : IEEE 10th International Symposium on Embedded Multicore/Many-core Systems-on-Chip, Sep 2016, Lyon, France. ⟨hal-01371467⟩

Share

Metrics

Record views

483

Files downloads

212