Robust Spectral 3D-bodypart Segmentation along Time

Fabio Cuzzolin 1 Diana Mateus 1 Edmond Boyer 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper we present a novel tool for body-part segmentation and tracking in the context of multiple camera systems. Our goal is to produce robust motion cues over time sequences, as required by human motion analysis applications. Given time sequences of 3D body shapes, body-parts are consistently identified over time without any supervision or a priori knowledge. The approach first maps shape representations of a moving body to an embedding space using locally linear embedding. While this map is updated at each time step, the shape of the embedded body remains stable. Robust clustering of body parts can then be performed in the embedding space by k-wise clustering, and temporal consistency is achieved by propagation of cluster centroids. The contribution with respect to methods proposed in the literature is a totally unsupervised spectral approach that takes advantage of temporal correlation to consistently segment body-parts over time. Comparisons on real data are run with direct segmentation in 3D by EM clustering and ISOMAP-based clustering: the way different approaches cope with topology transitions is discussed.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/inria-00590229
Contributor : Team Perception <>
Submitted on : Tuesday, May 3, 2011 - 9:46:40 AM
Last modification on : Wednesday, April 11, 2018 - 1:58:47 AM

Links full text

Identifiers

Collections

Citation

Fabio Cuzzolin, Diana Mateus, Edmond Boyer, Radu Horaud. Robust Spectral 3D-bodypart Segmentation along Time. 2nd Workshop on Human Motion, Understanding, Modeling, Capture and Animation, Oct 2007, Rio de Janeiro, Brazil. pp.196-211, ⟨10.1007/978-3-540-75703-0_14⟩. ⟨inria-00590229⟩

Share

Metrics

Record views

268