Skip to Main content Skip to Navigation
Book sections

Interaction with Machine Improvisation

Gérard Assayag 1 George Bloch 1 Arshia Cont 2, * Shlomo Dubnov 3
* Corresponding author
2 MuSync
STMS - Sciences et Technologies de la Musique et du Son, Inria Paris-Rocquencourt
Abstract : We describe two multi-agent architectures for an improvisation oriented musician-machine interaction systems that learn in real time from human performers. The improvisation kernel is based on sequence modeling and statistical learning. We present two frameworks of interaction with this kernel. In the first, the stylistic interaction is guided by a human operator in front of an interactive computer environment. In the second framework, the stylistic interaction is delegated to machine intelligence and therefore, knowledge propagation and decision are taken care of by the computer alone. The first framework involves a hybrid architecture using two popular composition/performance environments, Max and OpenMusic, that are put to work and communicate together, each one handling the process at a different time/memory scale. The second framework shares the same representational schemes with the first but uses an Active Learning architecture based on collaborative, competitive and memory-based learning to handle stylistic interactions. Both systems are capable of processing real-time audio/video as well as MIDI. After discussing the general cognitive background of improvisation practices, the statistical modelling tools and the concurrent agent architecture are presented. Then, an Active Learning scheme is described and considered in terms of using different improvisation regimes for improvisation planning. Finally, we provide more details about the different system implementations and describe several performances with the system.
Complete list of metadata

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/hal-00694801
Contributor : Arshia Cont <>
Submitted on : Sunday, May 6, 2012 - 6:14:16 PM
Last modification on : Tuesday, July 13, 2021 - 2:17:02 PM
Long-term archiving on: : Friday, November 30, 2012 - 11:15:24 AM

File

AL-chapter4.pdf
Files produced by the author(s)

Identifiers

Citation

Gérard Assayag, George Bloch, Arshia Cont, Shlomo Dubnov. Interaction with Machine Improvisation. Shlomo, Argamon and Shlomo, Dubnov and Kevin, Burns. The Structure of Style: Algorithmic Approaches to Understanding Manner and Meaning, Springer, pp.219-245, 2010, 978-3-642-12337-5. ⟨10.1007/978-3-642-12337-5_10⟩. ⟨hal-00694801⟩

Share

Metrics

Record views

644

Files downloads

846