Action Recognition from Arbitrary Views using 3D Exemplars

Daniel Weinland 1 Edmond Boyer 1 Rémi Ronfard 2
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper, we address the problem of learning compact, view-independent, realistic 3D models of human actions recorded with multiple cameras, for the purpose of recognizing those same actions from a single or few cameras, without prior knowledge about the relative orientations between the cameras and the subjects. To this aim, we propose a new framework where we model actions using three dimensional occupancy grids, built from multiple viewpoints, in an exemplar-based HMM. The novelty is, that a 3D reconstruction is not required during the recognition phase, instead learned 3D exemplars are used to produce 2D image information that is compared to the observations. Parameters that describe image projections are added as latent variables in the recognition process. In addition, the temporal Markov dependency applied to view parameters allows them to evolve during recognition as with a smoothly moving camera. The effectiveness of the framework is demonstrated with experiments on real datasets and with challenging recognition scenarios.
Keywords : action hmm
Document type :
Conference papers
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download


https://hal.inria.fr/inria-00544741
Contributor : Rémi Ronfard <>
Submitted on : Tuesday, December 14, 2010 - 4:36:04 PM
Last modification on : Monday, December 17, 2018 - 11:22:02 AM
Long-term archiving on : Tuesday, March 15, 2011 - 2:41:45 AM

Files

WBR07.pdf
Files produced by the author(s)

Identifiers

Citation

Daniel Weinland, Edmond Boyer, Rémi Ronfard. Action Recognition from Arbitrary Views using 3D Exemplars. ICCV 2007 - 11th IEEE International Conference on Computer Vision, Oct 2007, Rio de Janeiro, Brazil. pp.1-7, ⟨10.1109/ICCV.2007.4408849⟩. ⟨inria-00544741⟩

Share

Metrics

Record views

898

Files downloads

969