Energy consumption models and predictions for large-scale systems

Taghrid Samak 1, * Christine Morin 2 David Bailey 3
* Auteur correspondant
1 Advanced Computing for Science department
LBNL - Lawrence Berkeley National Laboratory [Berkeley]
2 MYRIADS - Design and Implementation of Autonomous Distributed Systems
IRISA-D1 - SYSTÈMES LARGE ÉCHELLE, Inria Rennes – Bretagne Atlantique
3 Computational Research Division
LBNL - Lawrence Berkeley National Laboratory [Berkeley]
Abstract : Responsible, efficient and well-planned power consumption is becoming a necessity for monetary returns and scalability of computing infrastructures. While there is a variety of sources from which power data can be obtained, analyzing this data is an intrinsically hard task. In this paper, we propose a data analysis pipeline that can handle the large-scale collection of energy consumption logs, apply sophisticated modeling to enable accurate prediction, and evaluate the efficiency of the analysis approach. We present the analysis of a power consumption data set collected over a 6-month period from two clusters of the Grid'5000 experimentation platform used in production. To solve the large data challenge, we used Hadoop with Pig data processing to generate a summary of the data that provides basic statistical aggregations, over different time scales. The aggregate data is then analyzed as a time series using sophisticated modeling methods with R statistical software. Energy models from such large dataset can help in understanding the evolution of consumption patterns, predicting future energy trends, and providing basis for generalizing the energy models to similar large-scale systems.
Type de document :
Communication dans un congrès
de Supinski, Bronis R. and Li, Dong. The Ninth Workshop on High-Performance, Power-Aware Computing, May 2013, Boston, United States. IEEE, 2013
Liste complète des métadonnées

https://hal.inria.fr/hal-00790349
Contributeur : Christine Morin <>
Soumis le : mercredi 20 février 2013 - 00:21:26
Dernière modification le : vendredi 16 novembre 2018 - 01:39:30

Identifiants

  • HAL Id : hal-00790349, version 1

Citation

Taghrid Samak, Christine Morin, David Bailey. Energy consumption models and predictions for large-scale systems. de Supinski, Bronis R. and Li, Dong. The Ninth Workshop on High-Performance, Power-Aware Computing, May 2013, Boston, United States. IEEE, 2013. 〈hal-00790349〉

Partager

Métriques

Consultations de la notice

593