Flot de scène

Antoine Letouzey 1 Benjamin Petit 1 Edmond Boyer 1
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper we study the estimation of dense, instantaneous 3D motion fields over a non-rigidly moving surface observed by multi-camera systems. The motivation arises from multi-camera applications that require motion information, for arbitrary subjects, in order to perform tasks such as surface tracking or segmentation. To this aim, we present a novel framework that allows to efficiently compute dense 3D displacement fields using low level visual cues and geometric constraints. The main contribution is a unified framework that combines flow constraints for small displacements with temporal feature constraints for large displacements and fuses them over a surface representation of the scene using local rigidity constraints. The resulting linear optimization problem allows for variational solutions and fast implementations. The proposed method adapts well wether geometric information arise from a complete 3D reconstruction, such as visual hull, or a depth map. Experiments conducted on synthetic and real data demonstrate the respective roles of flow and feature constraints as well as their ability to provide robust surface motion cues when combined.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [30 references]  Display  Hide  Download


https://hal.inria.fr/hal-00746460
Contributor : Edmond Boyer <>
Submitted on : Monday, October 29, 2012 - 10:11:06 AM
Last modification on : Wednesday, April 11, 2018 - 1:58:57 AM
Document(s) archivé(s) le : Wednesday, January 30, 2013 - 3:37:42 AM

Files

TS.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Antoine Letouzey, Benjamin Petit, Edmond Boyer. Flot de scène. Traitement du Signal, Lavoisier, 2012, 29 (3-5), pp.255-281. ⟨10.3166/ts.29.255-281⟩. ⟨hal-00746460⟩

Share

Metrics

Record views

436

Files downloads

473