Modelling Program's Performance with Gaussian Mixtures for Parametric Statistics

Abstract : —This article is a continuation of our previous research effort on program performance statistical analysis and comparison [1], in presence of program performance variability. In the previous study, we proposed a formal statistical methodology to analyse program speedups based on mean and median performance metrics: execution time, energy consumption, etc. However mean and median observed performances do not always reflect the user's feeling of such performances, especially when they are particularly unstable. In the current study, we propose additional precise performance metrics, based on performance modelling using Gaussian mixtures. Our additional statistical metrics for analysing and comparing program performances give the user more precise decision tools to select best code versions, not necessarily based on mean or median numbers. Also, we provide a new metric to estimate performance variability based on Gaussian mixture model. Our statistical methods are implemented with R and distributed as open source code.
Document type :
Journal articles
Complete list of metadatas

Cited literature [25 references]  Display  Hide  Download

https://hal.inria.fr/hal-01645009
Contributor : Sid Touati <>
Submitted on : Wednesday, November 22, 2017 - 5:42:12 PM
Last modification on : Thursday, February 7, 2019 - 3:46:50 PM

File

TMSCS-2016-12-0059-main.pdf
Files produced by the author(s)

Identifiers

Citation

Julien Worms, Sid Touati. Modelling Program's Performance with Gaussian Mixtures for Parametric Statistics. IEEE Transactions on Multi-Scale Computing Systems, IEEE, 2017, pp.16. ⟨10.1109/TMSCS.2017.2754251⟩. ⟨hal-01645009⟩

Share

Metrics

Record views

637

Files downloads

257