Multi-sensory display of self-avatar's physiological state: virtual breathing and heart beating can increase sensation of effort in VR - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Visualization and Computer Graphics Année : 2022

Multi-sensory display of self-avatar's physiological state: virtual breathing and heart beating can increase sensation of effort in VR

Résumé

In this paper we explore the multi-sensory display of self-avatars’ physiological state in Virtual Reality (VR), as a means to enhance the connection between the users and their avatar. Our approach consists in designing and combining a coherent set of visual, auditory and haptic cues to represent the avatar’s cardiac and respiratory activity. These sensory cues are modulated depending on the avatar’s simulated physical exertion. We notably introduce a novel haptic technique to represent respiratory activity using a compression belt simulating abdominal movements that occur during a breathing cycle. A series of experiments was conducted to evaluate the influence of our multi-sensory rendering techniques on various aspects of the VR user experience, including the sense of virtual embodiment and the sensation of effort during a walking simulation. A first study (N=30) that focused on displaying cardiac activity showed that combining sensory modalities significantly enhances the sensation of effort. A second study (N=20) that focused on respiratory activity showed that combining sensory modalities significantly enhances the sensation of effort as well as two sub-components of the sense of embodiment. Interestingly, the user’s actual breathing tended to synchronize with the simulated breathing, especially with the multi-sensory and haptic displays. A third study (N=18) that focused on the combination of cardiac and respiratory activity showed that combining both rendering techniques significantly enhances the sensation of effort. Taken together, our results promote the use of our novel breathing display technique and multi-sensory rendering of physiological parameters in VR applications where effort sensations are prominent, such as for rehabilitation, sport training, or exergames.
Fichier principal
Vignette du fichier
Multi-sensory_display_of_self-avatars_physiological_state_virtual_breathing_and_heart_beating_can_increase_sensation_of_effort_in_VR.pdf (2.35 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03928270 , version 1 (07-01-2023)

Identifiants

Citer

Yann Moullec, Justine Saint-Aubert, Julien Manson, Melanie Cogne, Anatole Lécuyer. Multi-sensory display of self-avatar's physiological state: virtual breathing and heart beating can increase sensation of effort in VR. IEEE Transactions on Visualization and Computer Graphics, 2022, 28 (11), pp.3596-3606. ⟨10.1109/TVCG.2022.3203120⟩. ⟨hal-03928270⟩
50 Consultations
158 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More