Interaction with Machine Improvisation

Gérard Assayag 1 George Bloch 1 Arshia Cont 2, * Shlomo Dubnov 3
* Auteur correspondant
2 MuSync
STMS - Sciences et Technologies de la Musique et du Son, Inria Paris-Rocquencourt
Abstract : We describe two multi-agent architectures for an improvisation oriented musician-machine interaction systems that learn in real time from human performers. The improvisation kernel is based on sequence modeling and statistical learning. We present two frameworks of interaction with this kernel. In the first, the stylistic interaction is guided by a human operator in front of an interactive computer environment. In the second framework, the stylistic interaction is delegated to machine intelligence and therefore, knowledge propagation and decision are taken care of by the computer alone. The first framework involves a hybrid architecture using two popular composition/performance environments, Max and OpenMusic, that are put to work and communicate together, each one handling the process at a different time/memory scale. The second framework shares the same representational schemes with the first but uses an Active Learning architecture based on collaborative, competitive and memory-based learning to handle stylistic interactions. Both systems are capable of processing real-time audio/video as well as MIDI. After discussing the general cognitive background of improvisation practices, the statistical modelling tools and the concurrent agent architecture are presented. Then, an Active Learning scheme is described and considered in terms of using different improvisation regimes for improvisation planning. Finally, we provide more details about the different system implementations and describe several performances with the system.
Type de document :
Chapitre d'ouvrage
Shlomo, Argamon and Shlomo, Dubnov and Kevin, Burns. The Structure of Style: Algorithmic Approaches to Understanding Manner and Meaning, Springer, pp.219-245, 2010, 978-3-642-12337-5. 〈10.1007/978-3-642-12337-5_10〉
Liste complète des métadonnées

Littérature citée [27 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00694801
Contributeur : Arshia Cont <>
Soumis le : dimanche 6 mai 2012 - 18:14:16
Dernière modification le : vendredi 25 mai 2018 - 12:02:07
Document(s) archivé(s) le : vendredi 30 novembre 2012 - 11:15:24

Fichier

AL-chapter4.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Gérard Assayag, George Bloch, Arshia Cont, Shlomo Dubnov. Interaction with Machine Improvisation. Shlomo, Argamon and Shlomo, Dubnov and Kevin, Burns. The Structure of Style: Algorithmic Approaches to Understanding Manner and Meaning, Springer, pp.219-245, 2010, 978-3-642-12337-5. 〈10.1007/978-3-642-12337-5_10〉. 〈hal-00694801〉

Partager

Métriques

Consultations de la notice

436

Téléchargements de fichiers

343