Skip to Main content Skip to Navigation
Journal articles

Collective mind: Towards practical and collaborative auto-tuning

Abstract : Empirical auto-tuning and machine learning techniques have been showing high potential to improve execution time, power consumption, code size, reliability and other important metrics of various applications for more than two decades. However, they are still far from widespread production use due to lack of native support for auto-tuning in an ever changing and complex software and hardware stack, large and multi-dimensional optimization spaces, excessively long exploration times, and lack of unified mechanisms for preserving and sharing of optimization knowledge and research material. We present a possible collaborative approach to solve above problems using Collective Mind knowledge management system. In contrast with previous cTuning framework, this modular infrastructure allows to preserve and share through the Internet the whole auto-tuning setups with all related artifacts and their software and hardware dependencies besides just performance data. It also allows to gradually structure, systematize and describe all available research material including tools, benchmarks, data sets, search strategies and machine learning models. Researchers can take advantage of shared components and data with extensible meta-description to quickly and collaboratively validate and improve existing auto-tuning and benchmarking techniques or prototype new ones. The community can now gradually learn and improve complex behavior of all existing computer systems while exposing behavior anomalies or model mispredictions to an interdisciplinary community in a reproducible way for further analysis. We present several practical, collaborative and model-driven auto-tuning scenarios. We also decided to release all material at http://c-mind.org/repo to set up an example for a collaborative and reproducible research as well as our new publication model in computer engineering where experimental results are continuously shared and validated by the community.
Complete list of metadata

Cited literature [72 references]  Display  Hide  Download

https://hal.inria.fr/hal-01054763
Contributor : Grigori Fursin <>
Submitted on : Friday, August 8, 2014 - 12:52:18 PM
Last modification on : Thursday, June 17, 2021 - 3:49:04 AM
Long-term archiving on: : Wednesday, November 26, 2014 - 4:11:05 PM

File

paper.pdf
Files produced by the author(s)

Identifiers

Citation

Grigori Fursin, Renato Miceli, Anton Lokhmotov, Michael Gerndt, Marc Baboulin, et al.. Collective mind: Towards practical and collaborative auto-tuning. Scientific Programming, IOS Press, 2014, Automatic Application Tuning for HPC Architectures, 22 (4), pp.309-329. ⟨10.3233/SPR-140396⟩. ⟨hal-01054763⟩

Share

Metrics

Record views

3643

Files downloads

1605