Retargetting Example Sounds to Interactive Physics-Driven Animations

Cécile Picard 1, 2 Nicolas Tsingos 2 François Faure 1, 3
1 EVASION - Virtual environments for animation and image synthesis of natural objects
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 REVES - Rendering and virtual environments with sound
CRISAM - Inria Sophia Antipolis - Méditerranée
3 ALCOVE - Collaborative interactive virtual environment
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, IRCICA
Abstract : This paper proposes a new method to generate audio in the context of interactive animations driven by a physics engine. Our approach aims at bridging the gap between direct playback of audio recordings and physically-based synthesis by retargetting audio grains extracted from the recordings according to the output of a physics engine. In an off-line analysis task, we automatically segment audio recordings into atomic grains. The segmentation depends on the type of contact event and we distinguished between impulsive events, e.g. impacts or breaking sounds, and continuous events, e.g. rolling or sliding sounds. We segment recordings of continuous events into sinusoidal and transient components, which we encode separately. A technique similar to matching pursuit is used to represent each original recording as a compact series of audio grains. During interactive animations, the grains are triggered individually or in sequence according to parameters reported from the physics engine and/or user-defined procedures. A first application is simply to reduce the size of the original audio assets. Above all, our technique allows to synthesize non-repetitive sounding events and provides extended authoring capabilities.
Type de document :
Communication dans un congrès
AES 35th International Conference, Audio in Games, Feb 2009, London, United Kingdom. Audio Engineering Society, pp.Article 25, 2009, 〈http://www.aes.org/e-lib/browse.cfm?elib=15179〉
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00394469
Contributeur : François Faure <>
Soumis le : jeudi 15 juillet 2010 - 04:29:08
Dernière modification le : mercredi 11 avril 2018 - 01:58:13
Document(s) archivé(s) le : vendredi 22 octobre 2010 - 11:58:13

Fichiers

FinalAes35th.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00394469, version 2

Collections

Citation

Cécile Picard, Nicolas Tsingos, François Faure. Retargetting Example Sounds to Interactive Physics-Driven Animations. AES 35th International Conference, Audio in Games, Feb 2009, London, United Kingdom. Audio Engineering Society, pp.Article 25, 2009, 〈http://www.aes.org/e-lib/browse.cfm?elib=15179〉. 〈inria-00394469v2〉

Partager

Métriques

Consultations de la notice

545

Téléchargements de fichiers

181