Perceptual Audio Rendering of Complex Virtual Environments - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport Année : 2003

Perceptual Audio Rendering of Complex Virtual Environments

Emmanuel Gallo
  • Fonction : Auteur
George Drettakis
  • Fonction : Auteur
  • PersonId : 831153

Résumé

Including spatialized audio in virtual environments significantly enhances the sense of realism and immersion. With the constant increase in complexity of virtual scenes, rendering spatialized audio is currently often impossible, due to the prohibitive signal processing costs of rendering a large number of sound sources. We present a novel solution to this problem permittin- g audiovisual rendering of environments containing hundreds of moving sound sources with complex frequency-dependent effects and reverberation processing on an consumer grade system. Our approach introduces three algorithms, based on perceptual culling, a clustering strategy allowing for rendering a large number of sound sources with only a limited number of available hardware 3D audio channels, and the use of graphics hardware to perform required pre-mixing operations on the audio signals. With little overhead to the graphics resources, our method leverages the use of existing audio rendering hardware while introducing additional controls and processing capabilities. We have implemented our approach, and we present results for a complex, highly dynamic virtual environment containing hundreds of sound sources, animated characters and moving objects. The results show that our approach permits high-quality interactive audio-visual rendering of such scenes.

Domaines

Autre [cs.OH]
Fichier principal
Vignette du fichier
RR-4734.pdf (784.81 Ko) Télécharger le fichier
Loading...

Dates et versions

inria-00071853 , version 1 (23-05-2006)

Identifiants

  • HAL Id : inria-00071853 , version 1

Citer

Nicolas Tsingos, Emmanuel Gallo, George Drettakis. Perceptual Audio Rendering of Complex Virtual Environments. RR-4734, INRIA. 2003. ⟨inria-00071853⟩
156 Consultations
167 Téléchargements

Partager

Gmail Facebook X LinkedIn More