Skip to Main content Skip to Navigation
Conference papers

Distributed Stream Processing with DUP

Abstract : This paper introduces the DUP System, a simple framework for parallel stream processing. The DUP System enables developers to compose applications from stages written in almost any programming language and to run distributed streaming applications across all POSIX-compatible platforms. Parallel applications written with the DUP System do not suffer from many of the problems that exist in traditional parallel languages. The DUP System includes a range of simple stages that serve as general-purpose building blocks for larger applications. This work describes the DUP Assembly language, the DUP architecture and some of the stages included in the DUP run-time library. We then present our experiences with parallelizing and distributing the ARB project, a package of tools for RNA/DNA sequence database handling and analysis.
Document type :
Conference papers
Complete list of metadata

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/hal-01054979
Contributor : Hal Ifip <>
Submitted on : Monday, August 11, 2014 - 9:10:35 AM
Last modification on : Thursday, May 2, 2019 - 2:14:06 PM
Long-term archiving on: : Wednesday, November 26, 2014 - 9:37:11 PM

File

main.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Kai Christian Bader, Tilo Eißler, Nathan Evans, Chris Gauthierdickey, Christian Grothoff, et al.. Distributed Stream Processing with DUP. IFIP International Conference on Network and Parallel Computing (NPC), Sep 2010, Zhengzhou, China. pp.232-246, ⟨10.1007/978-3-642-15672-4_21⟩. ⟨hal-01054979⟩

Share

Metrics

Record views

341

Files downloads

545