Real-time Inserting Virtual Characters into Dynamic Video Scene

Yijiang Zhang 1, 2 Xueying Qin 2 Julien Pettré 1 Qunsheng Peng 2
1 BUNRAKU - Perception, decision and action of real and virtual humans in virtual environments and impact on real environments
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, ENS Cachan - École normale supérieure - Cachan, Inria Rennes – Bretagne Atlantique
Abstract : The integration of moving virtual objects into real live-action scenes is an emerging topic. One difficult problem is to detect the presence of real moving obstacles, such as real people walking around, and to control the motion of virtual objects accordingly. This problem is however important to achieve geometrically coherent mixed reality content and to avoid irrealistic collisions between real and virtual objects. We propose a video-based solution. First, by analyzing the input video in real time, the motion states of the real targets are recovered into real 3D world. Secondly, under the constraint of the real dynamic targets, the virtual objects are controlled to move around and avoid the real targets in real time. Finally, to compute the visibility of each target, we extract each targets silhouette accurately which guarantees the computation of occlusion and location for the targets. Several examples demonstrate the efficacy of the proposed algorithm.
Type de document :
Communication dans un congrès
CHINAGRAPH, Oct 2010, nanjing, China. Zhejiang University, 2010
Liste complète des métadonnées
Contributeur : Julien Pettré <>
Soumis le : lundi 29 novembre 2010 - 14:09:32
Dernière modification le : mercredi 16 mai 2018 - 11:23:16


  • HAL Id : inria-00540883, version 1


Yijiang Zhang, Xueying Qin, Julien Pettré, Qunsheng Peng. Real-time Inserting Virtual Characters into Dynamic Video Scene. CHINAGRAPH, Oct 2010, nanjing, China. Zhejiang University, 2010. 〈inria-00540883〉



Consultations de la notice