Real-time Inserting Virtual Characters into Dynamic Video Scene

Yijiang Zhang 1, 2 Xueying Qin 2 Julien Pettré 1 Qunsheng Peng 2
1 BUNRAKU - Perception, decision and action of real and virtual humans in virtual environments and impact on real environments
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, ENS Cachan - École normale supérieure - Cachan, Inria Rennes – Bretagne Atlantique
Abstract : The integration of moving virtual objects into real live-action scenes is an emerging topic. One difficult problem is to detect the presence of real moving obstacles, such as real people walking around, and to control the motion of virtual objects accordingly. This problem is however important to achieve geometrically coherent mixed reality content and to avoid irrealistic collisions between real and virtual objects. We propose a video-based solution. First, by analyzing the input video in real time, the motion states of the real targets are recovered into real 3D world. Secondly, under the constraint of the real dynamic targets, the virtual objects are controlled to move around and avoid the real targets in real time. Finally, to compute the visibility of each target, we extract each targets silhouette accurately which guarantees the computation of occlusion and location for the targets. Several examples demonstrate the efficacy of the proposed algorithm.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/inria-00540883
Contributor : Julien Pettré <>
Submitted on : Monday, November 29, 2010 - 2:09:32 PM
Last modification on : Friday, November 16, 2018 - 1:28:50 AM

Identifiers

  • HAL Id : inria-00540883, version 1

Citation

Yijiang Zhang, Xueying Qin, Julien Pettré, Qunsheng Peng. Real-time Inserting Virtual Characters into Dynamic Video Scene. CHINAGRAPH, Oct 2010, nanjing, China. ⟨inria-00540883⟩

Share

Metrics

Record views

404