Energy consumption models and predictions for large-scale systems

Abstract : Responsible, efficient and well-planned power consumption is becoming a necessity for monetary returns and scalability of computing infrastructures. While there is a variety of sources from which power data can be obtained, analyzing this data is an intrinsically hard task. In this paper, we propose a data analysis pipeline that can handle the large-scale collection of energy consumption logs, apply sophisticated modeling to enable accurate prediction, and evaluate the efficiency of the analysis approach. We present the analysis of a power consumption data set collected over a 6-month period from two clusters of the Grid'5000 experimentation platform used in production. To solve the large data challenge, we used Hadoop with Pig data processing to generate a summary of the data that provides basic statistical aggregations, over different time scales. The aggregate data is then analyzed as a time series using sophisticated modeling methods with R statistical software. Energy models from such large dataset can help in understanding the evolution of consumption patterns, predicting future energy trends, and providing basis for generalizing the energy models to similar large-scale systems.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/hal-00790349
Contributor : Christine Morin <>
Submitted on : Wednesday, February 20, 2013 - 12:21:26 AM
Last modification on : Monday, July 1, 2019 - 2:14:06 PM

Identifiers

  • HAL Id : hal-00790349, version 1

Citation

Taghrid Samak, Christine Morin, David Bailey. Energy consumption models and predictions for large-scale systems. The Ninth Workshop on High-Performance, Power-Aware Computing, IEEE, May 2013, Boston, United States. ⟨hal-00790349⟩

Share

Metrics

Record views

638