Skip to Main content Skip to Navigation
Conference papers

A modular tool for automatic Soundpainting query recognition and music generation in Max/MSP

Abstract : This paper presents a modular software designed for automatic recognition of Soundpainting query. Soundpainting is a musical practice and a sign language used for real-time composition with an orchestra. A series of signs is gestured by the soundpainter creating a "sentence" describing a musical idea that they want the orchestra to perform. We propose an open-source tool, for Max/MSP, able to perform every task for a computer to be part of a Soundpainting scene: motion tracking, gesture recognition, query parsing and music generation. This tool is created in a modular way so that it can be easily modified to fit the needs of the user, for instance, changing the type of inputs for the motion tracking or adapting the Soundpainting grammar. We describe the global architecture, the different components of this tool, and the currently implemented methods for each of these components. We then show examples of use for this tool, from the learning of a new sign to a performance with several virtual instruments.
Complete list of metadata
Contributor : Ken Déguernel Connect in order to contact the contributor
Submitted on : Wednesday, June 16, 2021 - 4:34:50 PM
Last modification on : Tuesday, June 29, 2021 - 3:28:19 AM
Long-term archiving on: : Friday, September 17, 2021 - 7:21:24 PM


Publisher files allowed on an open archive


Distributed under a Creative Commons Attribution 4.0 International License


  • HAL Id : hal-03262673, version 1



Arthur Parmentier, Ken Déguernel, Constance Frei. A modular tool for automatic Soundpainting query recognition and music generation in Max/MSP. Sound and Music Computing, 2021, Torino (virtual), Italy. ⟨hal-03262673⟩



Record views


Files downloads