3D-Audio Matting, Post-editing and Re-rendering from Field Recordings

Abstract : We present a novel approach to real-time spatial rendering of realistic auditory environments and sound sources recorded live, in the field. Using a set of standard microphones distributed throughout a real-world environment, we record the sound field simultaneously from several locations. After spatial calibration, we segment from this set of recordings a number of auditory components, together with their location. We compare existing time delay of arrival estimation techniques between pairs of widely spaced microphones and introduce a novel efficient hierarchical localization algorithm. Using the high-level representation thus obtained, we can edit and rerender the acquired auditory scene over a variety of listening setups. In particular, we can move or alter the different sound sources and arbitrarily choose the listening position. We can also composite elements of different scenes together in a spatially consistent way. Our approach provides efficient rendering of complex soundscapes which would be challenging to model using discrete point sources and traditional virtual acoustics techniques. We demonstrate a wide range of possible applications for games, virtual and augmented reality, and audio visual post production.
Type de document :
Article dans une revue
EURASIP Journal on Advances in Signal Processing, SpringerOpen, 2007, pp.16. 〈10.1155/2007/47970〉
Liste complète des métadonnées

Littérature citée [70 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00606795
Contributeur : Team Reves <>
Soumis le : mardi 19 juillet 2011 - 15:44:20
Dernière modification le : samedi 27 janvier 2018 - 01:31:40
Document(s) archivé(s) le : jeudi 20 octobre 2011 - 02:20:44

Fichiers

eurasipJASP07.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Emmanuel Gallo, Nicolas Tsingos, Guillaume Lemaitre. 3D-Audio Matting, Post-editing and Re-rendering from Field Recordings. EURASIP Journal on Advances in Signal Processing, SpringerOpen, 2007, pp.16. 〈10.1155/2007/47970〉. 〈inria-00606795〉

Partager

Métriques

Consultations de la notice

220

Téléchargements de fichiers

209