Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

An Algebra with a Fixpoint Operator for Distributed Data Collections

Sarah Chlyah 1 Nils Gesbert 1 Pierre Genevès 1 Nabil Layaïda 1
1 TYREX - Types and Reasoning for the Web
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble [2007-2015]
Abstract : We present an algebra with a fixpoint operator which is suitable for modeling computations with distributed collections found in big data frameworks. We show that under reasonable conditions this fixpoint can be evaluated by parallel loops with one final merge rather than by a global loop requiring network overhead after each iteration. We also show when and how filters can be pushed through recursive terms, proposing optimisation rules. This makes it possible to develop algebraic optimizations in the presence of recursion, in a way which is especially suited for query optimizers and compilers targeting big data frameworks.
Complete list of metadatas

Cited literature [25 references]  Display  Hide  Download

https://hal.inria.fr/hal-02066649
Contributor : Tyrex Equipe <>
Submitted on : Wednesday, March 13, 2019 - 3:35:29 PM
Last modification on : Thursday, July 9, 2020 - 9:44:53 AM
Document(s) archivé(s) le : Friday, June 14, 2019 - 4:44:21 PM

File

article.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02066649, version 1

Collections

CNRS | INRIA | UGA | LIG

Citation

Sarah Chlyah, Nils Gesbert, Pierre Genevès, Nabil Layaïda. An Algebra with a Fixpoint Operator for Distributed Data Collections. 2019. ⟨hal-02066649⟩

Share

Metrics

Record views

171

Files downloads

370