Bimodal perception of audio-visual material properties for virtual environments

Abstract : High-quality rendering of both audio and visual material properties is very important in interac- tive virtual environments, since convicingly rendered materials increase realism and the sense of immersion. We studied how the level of detail of auditory and visual stimuli interact in the per- ception of audio-visual material rendering quality. Our study is based on perception of material discrimination, when varying the levels of detail of modal synthesis for sound, and Bidirectional Re ectance Distribution Functions for graphics. We performed an experiment for two di erent models (a Dragon and a Bunny model) and two material types (Plastic and Gold). The results show a signi cant interaction between auditory and visual level of detail in the perception of material similarity, when comparing approximate levels of detail to a high-quality audio-visual reference rendering. We show how this result can contribute to signi cant savings in computation time in an interactive audio-visual rendering system. To our knowledge this is the rst study which shows interaction of audio and graphics representation in a material perception task.
Type de document :
Article dans une revue
ACM Transactions on Applied Perception, Association for Computing Machinery, 2010, 7 (1), pp.1-16. 〈10.1145/1658349.1658350〉
Liste complète des métadonnées


https://hal.inria.fr/inria-00606826
Contributeur : Team Reves <>
Soumis le : mercredi 13 juillet 2011 - 15:31:44
Dernière modification le : mercredi 21 mars 2018 - 18:57:08
Document(s) archivé(s) le : vendredi 14 octobre 2011 - 02:21:00

Fichiers

soundingBRDF.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

Collections

Citation

Nicolas Bonneel, Clara Suied, Isabelle Viaud-Delmon, George Drettakis. Bimodal perception of audio-visual material properties for virtual environments. ACM Transactions on Applied Perception, Association for Computing Machinery, 2010, 7 (1), pp.1-16. 〈10.1145/1658349.1658350〉. 〈inria-00606826〉

Partager

Métriques

Consultations de la notice

258

Téléchargements de fichiers

103