Skip to Main content Skip to Navigation
Journal articles

Sparse Multi-View Consistency for Object Segmentation

Abdelaziz Djelouah 1, 2 Jean-Sébastien Franco 1 Edmond Boyer 1 François Le Clerc 2 Patrick Pérez 2
1 MORPHEO - Capture and Analysis of Shapes in Motion
Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, LJK - Laboratoire Jean Kuntzmann, Inria Grenoble - Rhône-Alpes
Abstract : Multiple view segmentation consists in segmenting objects simultaneously in several views. A key issue in that respect and compared to monocular settings is to ensure propagation of segmentation information between views while minimizing complexity and computational cost. In this work, we first investigate the idea that examining measurements at the projections of a sparse set of 3D points is sufficient to achieve this goal. The proposed algorithm softly assigns each of these 3D samples to the scene background if it projects on the background region in at least one view, or to the foreground if it projects on foreground region in all views. Second, we show how other modalities such as depth may be seamlessly integrated in the model and benefit the segmentation. The paper exposes a detailed set of experiments used to validate the algorithm, showing results comparable with the state of art, with reduced computational complexity. We also discuss the use of different modalities for specific situations, such as dealing with a low number of viewpoints or a scene with color ambiguities between foreground and background.
Document type :
Journal articles
Complete list of metadata

Cited literature [36 references]  Display  Hide  Download
Contributor : Jean-Sébastien Franco <>
Submitted on : Wednesday, February 11, 2015 - 12:03:23 PM
Last modification on : Tuesday, February 9, 2021 - 3:02:04 PM
Long-term archiving on: : Thursday, May 28, 2015 - 9:56:49 AM


Files produced by the author(s)






Abdelaziz Djelouah, Jean-Sébastien Franco, Edmond Boyer, François Le Clerc, Patrick Pérez. Sparse Multi-View Consistency for Object Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2015, 37 (9), pp.1890-1903. ⟨10.1109/TPAMI.2014.2385704⟩. ⟨hal-01115557⟩



Record views


Files downloads