Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

Benjamin Petit 1, 2 Jean-Denis Lesage 2 Clément Menier 1 Jérémie Allard 3 Jean-Sébastien Franco 4, 5 Bruno Raffin 2 Edmond Boyer 1 François Faure 6
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 MOAIS - PrograMming and scheduling design fOr Applications in Interactive Simulation
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
3 SHACRA - Simulation in Healthcare using Computer Research Advances
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, Inria Nancy - Grand Est
5 IPARLA - Visualization and manipulation of complex data on wireless mobile devices
Université Sciences et Technologies - Bordeaux 1, Inria Bordeaux - Sud-Ouest, École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), CNRS - Centre National de la Recherche Scientifique : UMR5800
6 EVASION - Virtual environments for animation and image synthesis of natural objects
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We present a multicamera real-time 3D modeling system that aims at enabling new immersive and interactive environments. This system, called Grimage, allows to retrieve in real-time a 3D mesh of the observed scene as well as the associated textures. This information enables a strong visual presence of the user into virtual worlds. The 3D shape information is also used to compute collisions and reaction forces with virtual objects, enforcing the mechanical presence of the user in the virtual world. The innovation is a fully integrated system with both immersive and interactive capabilities. It embeds a parallel version of the EPVH modeling algorithm inside a distributed vision pipeline. It also adopts the hierarchical component approach of the FlowVR middleware to enforce software modularity and enable distributed executions. Results show high refresh rates and low latencies obtained by taking advantage of the I/O and computing resources of PC clusters. The applications we have developed demonstrate the quality of the visual and mechanical presence with a single platform and with a dual platform that allows telecollaboration.
Complete list of metadatas
Contributor : Jérémie Allard <>
Submitted on : Wednesday, April 18, 2012 - 3:36:47 PM
Last modification on : Thursday, February 21, 2019 - 10:52:54 AM
Long-term archiving on : Monday, November 26, 2012 - 3:00:08 PM


Publisher files allowed on an open archive



Benjamin Petit, Jean-Denis Lesage, Clément Menier, Jérémie Allard, Jean-Sébastien Franco, et al.. Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration. International Journal of Digital Multimedia Broadcasting, Hindawi, 2010, Advances in 3DTV: Theory and Practice, 2010, Article ID 247108, 12 p. ⟨10.1155/2010/247108⟩. ⟨inria-00436467v3⟩



Record views


Files downloads