Collective mind: Towards practical and collaborative auto-tuning

Abstract : Empirical auto-tuning and machine learning techniques have been showing high potential to improve execution time, power consumption, code size, reliability and other important metrics of various applications for more than two decades. However, they are still far from widespread production use due to lack of native support for auto-tuning in an ever changing and complex software and hardware stack, large and multi-dimensional optimization spaces, excessively long exploration times, and lack of unified mechanisms for preserving and sharing of optimization knowledge and research material. We present a possible collaborative approach to solve above problems using Collective Mind knowledge management system. In contrast with previous cTuning framework, this modular infrastructure allows to preserve and share through the Internet the whole auto-tuning setups with all related artifacts and their software and hardware dependencies besides just performance data. It also allows to gradually structure, systematize and describe all available research material including tools, benchmarks, data sets, search strategies and machine learning models. Researchers can take advantage of shared components and data with extensible meta-description to quickly and collaboratively validate and improve existing auto-tuning and benchmarking techniques or prototype new ones. The community can now gradually learn and improve complex behavior of all existing computer systems while exposing behavior anomalies or model mispredictions to an interdisciplinary community in a reproducible way for further analysis. We present several practical, collaborative and model-driven auto-tuning scenarios. We also decided to release all material at to set up an example for a collaborative and reproducible research as well as our new publication model in computer engineering where experimental results are continuously shared and validated by the community.
Contributeur : Grigori Fursin <>
Soumis le : vendredi 8 août 2014 - 12:52:18
Dernière modification le : jeudi 9 février 2017 - 15:39:48
Document(s) archivé(s) le : mercredi 26 novembre 2014 - 16:11:05


Fichiers produits par l'(les) auteur(s)



Grigori Fursin, Renato Miceli, Anton Lokhmotov, Michael Gerndt, Marc Baboulin, et al.. Collective mind: Towards practical and collaborative auto-tuning. Scientific Programming, IOS Press, 2014, Automatic Application Tuning for HPC Architectures, 22 (4), pp.309-329. <10.3233/SPR-140396>. <hal-01054763>



Consultations de
la notice


Téléchargements du document