3D Multimodal Interaction with Physically-based Virtual Environments

Maud Marchal 1
1 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : The virtual has become a huge field of exploration for researchers: it could assist the surgeon, help the prototyping of industrial objects, simulate natural phenomena, be a fantastic time machine or entertain users through games or movies. Far beyond the only visual rendering of the virtual environment, the Virtual Reality aims at -literally- immersing the user in the virtual world. VR technologies simulate digital environments with which users can interact and, as a result, perceive through different modalities the effects of their actions in real time. The challenges are huge: the user's motions need to be perceived and to have an immediate impact on the virtual world by modifying the objects in real-time. In addition, the targeted immersion of the user is not only visual: auditory or haptic feedback needs to be taken into account, merging all the sensory modalities of the user into a multimodal answer. The global objective of my research activities is to improve 3D interaction with complex virtual environments by proposing novel approaches for physically-based and multimodal interaction. I have laid the foundations of my work on designing the interactions with complex virtual worlds, referring to a higher demand in the characteristics of the virtual environments. My research could be described within three main research axes inherent to the 3D interaction loop: (1) the physically-based modeling of the virtual world to take into account the complexity of the virtual object behavior, their topology modifications as well as their interactions, (2) the multimodal feedback for combining the sensory modalities into a global answer from the virtual world to the user and (3) the design of body-based 3D interaction techniques and devices for establishing the interfaces between the user and the virtual world. All these contributions could be gathered in a general framework within the 3D interaction loop. By improving all the components of this framework, I aim at proposing approaches that could be used in future virtual reality applications but also more generally in other areas such as medical simulation, gesture training, robotics, virtual prototyping for the industry or web contents.
Document type :
Habilitation à diriger des recherches
Complete list of metadatas

Cited literature [120 references]  Display  Hide  Download

https://hal.inria.fr/tel-01139872
Contributor : Maud Marchal <>
Submitted on : Tuesday, April 7, 2015 - 11:44:49 AM
Last modification on : Thursday, November 15, 2018 - 11:58:46 AM
Long-term archiving on : Tuesday, April 18, 2017 - 12:08:39 PM

Identifiers

  • HAL Id : tel-01139872, version 1

Citation

Maud Marchal. 3D Multimodal Interaction with Physically-based Virtual Environments. Graphics [cs.GR]. Université de Rennes 1, 2014. ⟨tel-01139872⟩

Share

Metrics

Record views

752

Files downloads

418