Skip to Main content Skip to Navigation
Conference papers

Taming Energy Consumption Variations in Systems Benchmarking

Abstract : The past decade witnessed the inclusion of power measurements to evaluate the energy efficiency of software systems, thus making energy a prime indicator along with performance. Nevertheless, measuring the energy consumption of a software system remains a tedious task for practitioners. In particular, the energy measurement process may be subject to a lot of variations that hinder the relevance of potential comparisons. While the state of the art mostly acknowledged the impact of hardware factors (chip printing process, CPU temperature), this paper investigates the impact of controllable factors on these variations. More specifically, we conduct an empirical study of multiple controllable parameters that one can easily tune to tame the energy consumption variations when benchmarking software systems. To better understand the causes of such variations, we ran more than a 1000 experiments on more than 100 machines with different workloads and configurations. The main factors we studied encompass: experimental protocol, CPU features (C-states, Turbo~Boost, core pinning) and generations, as well as the operating system. Our experiments showed that, for some workloads, it is possible to tighten the energy variation by up to 30×. Finally, we summarize our results as guidelines to tame energy consumption variations. We argue that the guidelines we deliver are the minimal requirements to be considered prior to any energy efficiency evaluation
Document type :
Conference papers
Complete list of metadata

Cited literature [27 references]  Display  Hide  Download
Contributor : Romain Rouvoy Connect in order to contact the contributor
Submitted on : Friday, January 24, 2020 - 5:21:44 PM
Last modification on : Friday, December 11, 2020 - 6:44:06 PM
Long-term archiving on: : Saturday, April 25, 2020 - 5:00:50 PM


Files produced by the author(s)



Zakaria Ournani, Mohammed Chakib Belgaid, Romain Rouvoy, Pierre Rust, Joël Penhoat, et al.. Taming Energy Consumption Variations in Systems Benchmarking. ICPE'2020 - 11th ACM/SPEC International Conference on Performance Engineering, Apr 2020, Edmonton, Canada. ⟨10.1145/3358960.3379142⟩. ⟨hal-02403379⟩



Record views


Files downloads