Intra-query Adaptivity for MapReduce Query Processing Systems

Edson Ramiro Lucas Filho 1 Eduardo Cunha de Almeida 2, 3 Yves Le Traon 1
1 SnT - Interdisciplinary Centre for Security, Reliability and Trust [Luxembourg]
2 UFPR - Universidade Federal do Parana [Curitiba]
3 CSC - Computer Science and Communications Research Unit [Luxembourg]
Abstract : MapReduce query processing systems translate a query statement into a query plan, consisting of a set of MapReduce jobs to be executed in distributed machines. During query translation, these query systems uniformly allocate computing resources to each job by delegating the same tuning to the entire query plan. However, jobs may implement their own collection of operators, which lead to different usage of computing resources. In this paper we propose an adaptive tuning mechanism that enables setting specific resources to each job within a query plan. Our adaptive mechanism relies on a data structure that maps jobs to tuning codes by analyzing source code and log files. This adaptive mechanism allows delegating specific resources to the query plan at runtime as the data structure hosts specific precomputed tuning codes.
Type de document :
Communication dans un congrès
IDEAS 2014 : 18th International Database Engineering & Applications Symposium, Jul 2014, Porto, Portugal. 2014
Liste complète des métadonnées

Littérature citée [5 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/hal-01018087
Contributeur : Eduardo Cunha de Almeida <>
Soumis le : jeudi 3 juillet 2014 - 15:58:21
Dernière modification le : jeudi 3 juillet 2014 - 16:03:36
Document(s) archivé(s) le : vendredi 3 octobre 2014 - 11:46:17

Fichier

ideas14_selftuning.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01018087, version 1

Citation

Edson Ramiro Lucas Filho, Eduardo Cunha de Almeida, Yves Le Traon. Intra-query Adaptivity for MapReduce Query Processing Systems. IDEAS 2014 : 18th International Database Engineering & Applications Symposium, Jul 2014, Porto, Portugal. 2014. 〈hal-01018087〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

245

Téléchargements de fichiers

293

Contact


archive-ouverte@inria.fr