HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

Sparse Multi-View Consistency for Object Segmentation

Abdelaziz Djelouah 1, 2 Jean-Sébastien Franco 1 Edmond Boyer 1 François Le Clerc 2 Patrick Pérez 2
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : Multiple view segmentation consists in segmenting objects simultaneously in several views. A key issue in that respect and compared to monocular settings is to ensure propagation of segmentation information between views while minimizing complexity and computational cost. In this work, we first investigate the idea that examining measurements at the projections of a sparse set of 3D points is sufficient to achieve this goal. The proposed algorithm softly assigns each of these 3D samples to the scene background if it projects on the background region in at least one view, or to the foreground if it projects on foreground region in all views. Second, we show how other modalities such as depth may be seamlessly integrated in the model and benefit the segmentation. The paper exposes a detailed set of experiments used to validate the algorithm, showing results comparable with the state of art, with reduced computational complexity. We also discuss the use of different modalities for specific situations, such as dealing with a low number of viewpoints or a scene with color ambiguities between foreground and background.
Document type :
Journal articles
Complete list of metadata

Cited literature [36 references]  Display  Hide  Download

Contributor : Jean-Sébastien Franco Connect in order to contact the contributor
Submitted on : Wednesday, February 11, 2015 - 12:03:23 PM
Last modification on : Wednesday, May 4, 2022 - 9:56:06 AM
Long-term archiving on: : Thursday, May 28, 2015 - 9:56:49 AM


Files produced by the author(s)






Abdelaziz Djelouah, Jean-Sébastien Franco, Edmond Boyer, François Le Clerc, Patrick Pérez. Sparse Multi-View Consistency for Object Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2015, 37 (9), pp.1890-1903. ⟨10.1109/TPAMI.2014.2385704⟩. ⟨hal-01115557⟩



Record views


Files downloads