Motion Panoramas

Adrien Bartoli 1 Navneet Dalal 1 Radu Horaud 1
1 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : In this paper we describe a method for analysing video sequences and for representing them as mosaics or panoramas. Previous work on video mosaicking essentially concentrated on static scenes. We generalise these approaches to the case of a rotating camera observing both static and moving objects where the static portions of the scene are not necessarily dominant, as it has been often hypothesised in the past. We start by describing a robust technique for accurately aligning a large number of video frames under unknown camera rotations and camera settings. The alignment technique combines a feature-based method (initialisation and refinement) with rough motion segmentation followed by a colour-based direct method (final adjustment). This precise frame-to-frame alignment allows the dynamic building of a background representation as well as an efficient segmentation of each image such that moving regions of arbitrary shape and size are aligned with the static background. Thus a motion panorama visualises both dynamic and static scene elements in a geometrically consistent way. Extensive experiments applied to archived videos of track-and-field events validate the approach.
Document type :
Reports
Complete list of metadatas

https://hal.inria.fr/inria-00071815
Contributor : Rapport de Recherche Inria <>
Submitted on : Tuesday, May 23, 2006 - 6:52:40 PM
Last modification on : Wednesday, April 11, 2018 - 1:54:11 AM
Long-term archiving on: Sunday, April 4, 2010 - 10:39:22 PM

Identifiers

  • HAL Id : inria-00071815, version 1

Collections

Citation

Adrien Bartoli, Navneet Dalal, Radu Horaud. Motion Panoramas. [Research Report] RR-4771, INRIA. 2003. ⟨inria-00071815⟩

Share

Metrics

Record views

227

Files downloads

121