Real-Time Capture, Reconstruction and Insertion into Virtual World of Human Actors

Jean-Marc Hasenfratz 1 Marc Lapierre 1 Jean-Dominique Gascuel 1, * Edmond Boyer 2
* Corresponding author
1 ARTIS - Acquisition, representation and transformations for image synthesis
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
2 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : In this paper, we show how to capture an actor with no intrusive trackers and without any special environment like blue set, how to estimate its 3D-geometry and how to insert this geometry into a virtual world in real-time. We use several cameras in conjunction with background subtraction to produce silhouettes of the actor as observed from the different camera viewpoints. These silhouettes allow the 3D-geometry of the actor to be estimated by a voxel based method. This geometry is rendered with a marching cube algorithm and inserted into a virtual world. Shadows of the actor corresponding to virtual lights are then added and interactions with objects of the virtual world are proposed. The main originality of this paper is to propose a complete pipeline that can computes up to 30 frames per second. Since the rapidity of the process depends mainly on its slowest step, we present here all these steps. For each of them, we present and discuss the solution that is used. Some of them are new solutions, as the 3D shape estimation which is achieved using graphics hardware. Results are presented and discussed.
keyword : Real-time capture
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download


https://hal.inria.fr/inria-00510183
Contributor : Team Evasion <>
Submitted on : Thursday, October 14, 2010 - 4:33:02 PM
Last modification on : Wednesday, April 11, 2018 - 1:53:27 AM
Long-term archiving on : Saturday, January 15, 2011 - 2:25:24 AM

Files

VVG-2003.pdf
Publisher files allowed on an open archive

Identifiers

  • HAL Id : inria-00510183, version 1

Collections

IMAG | INRIA | UGA

Citation

Jean-Marc Hasenfratz, Marc Lapierre, Jean-Dominique Gascuel, Edmond Boyer. Real-Time Capture, Reconstruction and Insertion into Virtual World of Human Actors. Vision, Video and Graphics, Eurographics, 2003, Bath, United Kingdom. pp.49--56. ⟨inria-00510183⟩

Share

Metrics

Record views

696

Files downloads

992