Typing heterogeneous dataflow graphs for static buffering and scheduling

Pierre Donat-Bouillud 1, 2 Jean-Louis Giavitto 2
2 Repmus - Représentations musicales
STMS - Sciences et Technologies de la Musique et du Son
Abstract : Interactive multimedia system usually represents computations as a dataflow graph – the patching model. Nowadays , dataflow graphs integrate multiple medias from various dedicated languages and systems, with multiple rates, for instance audio rate, video rate, control rate, but also the rate of FFT frames, as well as requirements on buffer sizes, or on what kind of data they consume or produce. We design a type system for the DSP extension of Antescofo that makes it possible to safely combine effects in such a heterogeneous graph. We show how to infer the types given known types in the graph, and how we use this type system to compute buffer sizes and to schedule the graph. Our approach is exemplified on an Antescofo program that does speed tracking of a foreground object in a video stream to drive an audio effect.
Liste complète des métadonnées

Cited literature [14 references]  Display  Hide  Download

https://hal.inria.fr/hal-01585489
Contributor : Pierre Donat-Bouillud <>
Submitted on : Monday, September 11, 2017 - 3:35:06 PM
Last modification on : Thursday, March 21, 2019 - 1:05:02 PM

File

antescofo_icmc2017.pdf
Files produced by the author(s)

Début de la conférence

Identifiers

  • HAL Id : hal-01585489, version 1

Citation

Pierre Donat-Bouillud, Jean-Louis Giavitto. Typing heterogeneous dataflow graphs for static buffering and scheduling. ICMC 2017 - 43rd International Computer Music Conference, Oct 2017, Shanghai, China. ⟨hal-01585489⟩

Share

Metrics

Record views

148

Files downloads

56