Skip to Main content Skip to Navigation
Conference papers

Taming Energy Consumption Variations in Systems Benchmarking

Abstract : The past decade witnessed the inclusion of power measurements to evaluate the energy efficiency of software systems, thus making energy a prime indicator along with performance. Nevertheless, measuring the energy consumption of a software system remains a tedious task for practitioners. In particular, the energy measurement process may be subject to a lot of variations that hinder the relevance of potential comparisons. While the state of the art mostly acknowledged the impact of hardware factors (chip printing process, CPU temperature), this paper investigates the impact of controllable factors on these variations. More specifically, we conduct an empirical study of multiple controllable parameters that one can easily tune to tame the energy consumption variations when benchmarking software systems. To better understand the causes of such variations, we ran more than a 1000 experiments on more than 100 machines with different workloads and configurations. The main factors we studied encompass: experimental protocol, CPU features (C-states, Turbo~Boost, core pinning) and generations, as well as the operating system. Our experiments showed that, for some workloads, it is possible to tighten the energy variation by up to 30×. Finally, we summarize our results as guidelines to tame energy consumption variations. We argue that the guidelines we deliver are the minimal requirements to be considered prior to any energy efficiency evaluation
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/hal-02403379
Contributor : Romain Rouvoy <>
Submitted on : Friday, January 24, 2020 - 5:21:44 PM
Last modification on : Thursday, April 30, 2020 - 10:05:22 PM
Document(s) archivé(s) le : Saturday, April 25, 2020 - 5:00:50 PM

File

ournani-icpe-20.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02403379, version 1

Citation

Zakaria Ournani, Mohammed Chakib Belgaid, Romain Rouvoy, Pierre Rust, Joël Penhoat, et al.. Taming Energy Consumption Variations in Systems Benchmarking. ICPE'2020 - 11th ACM/SPEC International Conference on Performance Engineering, Apr 2020, Edmonton, Canada. ⟨hal-02403379⟩

Share

Metrics

Record views

208

Files downloads

392