Abstract: In video-based rendering, real dynamic scenes are captured by video cameras and replayed, so that they can be seen by the observer from any viewpoint. In order to permit a complete immersion of the real scene in a virtual environment, some approaches reconstruct a 3D shape and then textured it with images taken from the cameras.
This paper proposes to identify the problems of multi-view texturing for video-based rendering and to offer solutions for a number of them.We successfully treat visibility issues, identify “risk zones”, correct projection displacement errors and fill in small untextured areas. Our algorithm works in real time, thus permitting an interactive viewing of the augmented scene