MoSART: Mobile Spatial Augmented Reality for 3D Interaction With Tangible Objects

Guillaume Cortes 1, 2, 3 Eric Marchand 2 Guillaume Brincin 1 Anatole Lécuyer 3
2 RAINBOW - Sensor-based and interactive robotics
Inria Rennes – Bretagne Atlantique , IRISA_D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
3 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA_D6 - MEDIA ET INTERACTIONS
Abstract : In this paper we introduce MoSART, a novel approach for Mobile Spatial Augmented Reality on Tangible objects. MoSART is dedicated to mobile interaction with tangible objects in single or collaborative situations. It is based on a novel " all-in-one " Head-Mounted Display (AMD) including a projector (for the SAR display) and cameras (for the scene registration). Equipped with the HMD the user is able to move freely around tangible objects and manipulate them at will. The system tracks the position and orientation of the tangible 3D objects and projects virtual content over them. The tracking is a feature-based stereo optical tracking providing high accuracy and low latency. A projection mapping technique is used for the projection on the tangible objects which can have a complex 3D geometry. Several interaction tools have also been designed to interact with the tangible and augmented content, such as a control panel and a pointer metaphor, which can benefit as well from the MoSART projection mapping and tracking features. The possibilities offered by our novel approach are illustrated in several use cases, in single or collaborative situations, such as for virtual prototyping, training or medical visualization.
Document type :
Journal articles
Complete list of metadatas

Cited literature [11 references]  Display  Hide  Download

https://hal.inria.fr/hal-01858154
Contributor : Eric Marchand <>
Submitted on : Monday, August 20, 2018 - 10:11:23 AM
Last modification on : Thursday, November 15, 2018 - 11:59:02 AM
Long-term archiving on : Wednesday, November 21, 2018 - 12:40:39 PM

File

frobt-05-00093.pdf
Files produced by the author(s)

Identifiers

Citation

Guillaume Cortes, Eric Marchand, Guillaume Brincin, Anatole Lécuyer. MoSART: Mobile Spatial Augmented Reality for 3D Interaction With Tangible Objects. Frontiers in Robotics and AI, Frontiers Media S.A., 2018, 5 (93), pp.1-13. ⟨10.3389/frobt.2018.00093⟩. ⟨hal-01858154⟩

Share

Metrics

Record views

594

Files downloads

308