Independent Viewpoint Silhouette-based Human Action Modelling and Recognition

Abstract : This paper addresses the problem of silhouette-based human action modelling and recognition independently of the camera point of view. Action recognition is carried out by comparing a 2D motion template, built from observations, with learned models of the same type captured from a wide range of viewpoints. All these 2D motion templates, are projected into a new subspace by means of the Kohonen Self Organizing feature Map (SOM). A specific SOM is trained for every action, grouping viewpoint (spatial) and movement (temporal) in a principal manifold. This approach enables the interpolation of data ”between different viewpoints” and, at the same time, to establish motion correspondences between viewpoints without considering a mapping to a complex 3D model. Every new 2D motion template gives a distance to the map, related to the probability that motion feature belongs to that particular action. Action recognition is accomplished by a Maximum Likelihood (ML) classifier over all specific-action SOMs. We demonstrate this approach on two challenging video sets: one based on real actors making 11 complex actions and another one based on virtual actors performing 20 different actions.
Type de document :
Communication dans un congrès
The 1st International Workshop on Machine Learning for Vision-based Motion Analysis - MLVMA'08, Oct 2008, Marseille, France. 2008
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00326715
Contributeur : Peter Sturm <>
Soumis le : dimanche 5 octobre 2008 - 12:31:39
Dernière modification le : lundi 6 octobre 2008 - 09:43:19
Document(s) archivé(s) le : vendredi 4 juin 2010 - 12:12:35

Fichier

mlvma08_submission_23.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00326715, version 1

Collections

Citation

Carlos Orrite, Francisco Martínez, Elías Herrero, Hossein Ragheb, Sergio Velastin. Independent Viewpoint Silhouette-based Human Action Modelling and Recognition. The 1st International Workshop on Machine Learning for Vision-based Motion Analysis - MLVMA'08, Oct 2008, Marseille, France. 2008. 〈inria-00326715〉

Partager

Métriques

Consultations de la notice

313

Téléchargements de fichiers

212