s'authentifier
version française rss feed

inria-00281383, version 1

A Real-Time System for Full Body Interaction with Virtual Worlds

Jean-Marc Hasenfratz () a1, Marc Lapierre 1, François X. Sillion () b1

Eurographics Symposium on Virtual Environments (2004) 147--156

Résumé : Real-time video acquisition is becoming a reality with the most recent camera technology. Three-dimensional models can be reconstructed from multiple views using visual hull carving techniques. However the combination of these approaches to obtain a moving 3D model from simultaneous video captures remains a technological challenge. In this paper we demonstrate a complete system architecture allowing the real-time (≥ 30 fps) acquisition and full-body reconstruction of one or several actors, which can then be integrated in a virtual environment. A volume of approximately 2m3 is observed with (at least) four video cameras and the video fluxes are processed to obtain a volumetric model of the moving actors. The reconstruction process uses a mixture of pipelined and parallel processing, using N individual PCs for N cameras and a central computer for integration, reconstruction and display. A surface description is obtained using a marching cubes algorithm. We discuss the overall architecture choices, with particular emphasis on the real-time constraint and latency issues, and demonstrate that a software synchronization of the video fluxes is both sufficient and efficient. The ability to reconstruct a full-body model of the actors and any additional props or elements opens the way for very natural interaction techniques using the entire body and real elements manipulated by the user, whose avatar is immersed in a virtual world.

  • Icone de bg_subtraction.jpg
  • Icone de 00interaction_single.jpg
  • Icone de 0interaction.jpg
  • Icone de actor_and_its_avatar.jpg
  • Icone de avatar_different_aspects.jpg
  • a –  Université Pierre Mendès-France - Grenoble II
  • b –  INRIA
  • 1 :  ARTIS (IMAG-INRIA Rhône-Alpes / GRAVIR)
  • CNRS : FR71 – CNRS : UMR5527 – INRIA – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)
  • Domaine : Informatique/Synthèse d'image et réalité virtuelle
 
  • inria-00281383, version 1
  • oai:hal.inria.fr:inria-00281383
  • Contributeur : 
  • Soumis le : Jeudi 22 Mai 2008, 10:49:40
  • Dernière modification le : Mardi 19 Octobre 2010, 13:51:51
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...