Action Recognition from Arbitrary Views using 3D Exemplars

Daniel Weinland 1 Edmond Boyer 1 Rémi Ronfard 2
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper, we address the problem of learning compact, view-independent, realistic 3D models of human actions recorded with multiple cameras, for the purpose of recognizing those same actions from a single or few cameras, without prior knowledge about the relative orientations between the cameras and the subjects. To this aim, we propose a new framework where we model actions using three dimensional occupancy grids, built from multiple viewpoints, in an exemplar-based HMM. The novelty is, that a 3D reconstruction is not required during the recognition phase, instead learned 3D exemplars are used to produce 2D image information that is compared to the observations. Parameters that describe image projections are added as latent variables in the recognition process. In addition, the temporal Markov dependency applied to view parameters allows them to evolve during recognition as with a smoothly moving camera. The effectiveness of the framework is demonstrated with experiments on real datasets and with challenging recognition scenarios.
Keywords : action hmm
Type de document :
Communication dans un congrès
ICCV 2007 - 11th IEEE International Conference on Computer Vision, Oct 2007, Rio de Janeiro, Brazil. IEEE, pp.1-7, 2007, 〈10.1109/ICCV.2007.4408849〉
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00544741
Contributeur : Rémi Ronfard <>
Soumis le : mardi 14 décembre 2010 - 16:36:04
Dernière modification le : mercredi 11 avril 2018 - 01:58:26
Document(s) archivé(s) le : mardi 15 mars 2011 - 02:41:45

Fichiers

WBR07.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Daniel Weinland, Edmond Boyer, Rémi Ronfard. Action Recognition from Arbitrary Views using 3D Exemplars. ICCV 2007 - 11th IEEE International Conference on Computer Vision, Oct 2007, Rio de Janeiro, Brazil. IEEE, pp.1-7, 2007, 〈10.1109/ICCV.2007.4408849〉. 〈inria-00544741〉

Partager

Métriques

Consultations de la notice

666

Téléchargements de fichiers

765