Probabilistic Factor Oracles for Multidimensional Machine Improvisation

Ken Déguernel 1, 2 Emmanuel Vincent 3 Gérard Assayag 2
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
2 Repmus - Représentations musicales
STMS - Sciences et Technologies de la Musique et du Son
3 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This paper presents two methods using training over multidimensional sequences for automatic improvisation. We consider as dimensions musical features such as melody, harmony, timbre, etc. We first present a system combining interpolated probabilistic models with a factor oracle. The probabilistic models are trained on a corpus to learn the correlation between dimensions and are used to guide the navigation in the factor oracle that ensure a logical improvisation. Improvisations are therefore created in a way where the intuition of a context is enriched with multidimensional knowledge. We then introduce a system creating multidimensional improvisations based on communication between dimensions via probabilistc message passing. The communication infers some anticipatory behaviour on each dimension now influenced by the others, creating a consistent multidimensional improvisation. Both systems are evaluated by professional improvisers during listening sessions. Overall, they receive good feedback and show encouraging results, first on how multidimensional knowledge can help performing better navigation in the factor oracle and second on how communication through message passing can emulate the interactivity between dimensions or musicians.
Complete list of metadatas

Cited literature [35 references]  Display  Hide  Download

https://hal.inria.fr/hal-01693750
Contributor : Ken Déguernel <>
Submitted on : Friday, January 26, 2018 - 2:54:45 PM
Last modification on : Thursday, March 21, 2019 - 2:20:12 PM
Long-term archiving on : Friday, May 25, 2018 - 1:46:28 PM

File

Probabilistic_Factor_Oracles_C...
Files produced by the author(s)

Licence


Public Domain

Identifiers

  • HAL Id : hal-01693750, version 1

Citation

Ken Déguernel, Emmanuel Vincent, Gérard Assayag. Probabilistic Factor Oracles for Multidimensional Machine Improvisation. Computer Music Journal, Massachusetts Institute of Technology Press (MIT Press): Arts & Humanities Titles etc, In press. ⟨hal-01693750v1⟩

Share

Metrics

Record views

199

Files downloads

56