Improving Surface Normals Based Action Recognition in Depth Images

Xuan Nguyen 1 Thanh Nguyen 2 François Charpillet 1
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : In this paper, we propose a new local descriptor for action recognition in depth images. Our proposed descrip-tor jointly encodes the shape and motion cues using surface normals in 4D space of depth, time, spatial coordinates and higher-order partial derivatives of depth values along spatial coordinates. In a traditional Bag-of-words (BoW) approach, local descriptors extracted from a depth sequence are encoded to form a global representation of the sequence. In our approach, local descriptors are encoded using Sparse Coding (SC) and Fisher Vector (FV), which have been recently proven effective for action recognition. Action recognition is then simply performed using a linear SVM classifier. Our proposed action descriptor is evaluated on two public benchmark datasets, MSRAction3D and MSRGesture3D. The experimental result shows the effectiveness of the proposed method on both the datasets.
Type de document :
Communication dans un congrès
13th International Conference on Advanced Video and Signal-Based Surveillance, Aug 2016, Colorado Springs, United States. 2016
Liste complète des métadonnées

Littérature citée [33 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01409043
Contributeur : François Charpillet <>
Soumis le : mardi 6 décembre 2016 - 09:07:04
Dernière modification le : jeudi 15 mars 2018 - 16:56:07
Document(s) archivé(s) le : mardi 21 mars 2017 - 02:33:51

Fichier

AVSS2016.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01409043, version 1

Citation

Xuan Nguyen, Thanh Nguyen, François Charpillet. Improving Surface Normals Based Action Recognition in Depth Images. 13th International Conference on Advanced Video and Signal-Based Surveillance, Aug 2016, Colorado Springs, United States. 2016. 〈hal-01409043〉

Partager

Métriques

Consultations de la notice

143

Téléchargements de fichiers

206