Perceptual Audio Rendering of Complex Virtual Environments

Nicolas Tsingos 1 Emmanuel Gallo 1 George Drettakis 1
1 REVES - Rendering and virtual environments with sound
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : We propose a real-time 3D audio rendering pipeline for complex virtual scenes containing hundreds of moving sound sources. The approach, based on auditory culling and spatial level-of-detail, can handle more than ten times the number of sources commonly available on consumer 3D audio hardware, with minimal decrease in audio quality. The method performs well for both indoor and outdoor environments. It leverages the limited capabilities of audio hardware for many applications, including interactive architectural acoustics simulations and automatic 3D voice management for video games.Our approach dynamically eliminates inaudible sources and groups the remaining audible sources into a budget number of clusters. Each cluster is represented by one impostor sound source, positioned using perceptual criteria. Spatial audio processing is then performed only on the impostor sound sources rather than on every original source thus greatly reducing the computational cost.A pilot validation study shows that degradation in audio quality, as well as localization impairment, are limited and do not seem to vary significantly with the cluster budget. We conclude that our real-time perceptual audio rendering pipeline can generate spatialized audio for complex auditory environments without introducing disturbing changes in the resulting perceived soundfield.
Type de document :
Article dans une revue
ACM Transactions on Graphics, Association for Computing Machinery, 2004, SIGGRAPH Conference Proceedings, 23 (3), pp.249--258. 〈10.1145/1186562.1015710〉
Liste complète des métadonnées

Littérature citée [25 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00607211
Contributeur : Team Reves <>
Soumis le : vendredi 8 juillet 2011 - 13:46:04
Dernière modification le : samedi 27 janvier 2018 - 01:31:36
Document(s) archivé(s) le : dimanche 9 octobre 2011 - 02:25:18

Identifiants

Collections

Citation

Nicolas Tsingos, Emmanuel Gallo, George Drettakis. Perceptual Audio Rendering of Complex Virtual Environments. ACM Transactions on Graphics, Association for Computing Machinery, 2004, SIGGRAPH Conference Proceedings, 23 (3), pp.249--258. 〈10.1145/1186562.1015710〉. 〈inria-00607211〉

Partager

Métriques

Consultations de la notice

374

Téléchargements de fichiers

721