Effective Surface Normals Based Action Recognition in Depth Images

Xuan Nguyen 1 Thanh Nguyen 2 François Charpillet 1
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : In this paper, we propose a new local descriptor for action recognition in depth images. The proposed descriptor relies on surface normals in 4D space of depth, time, spatial coordinates and higher-order partial derivatives of depth values along spatial coordinates. In order to classify actions, we follow the traditional Bag-of-words (BoW) approach, and propose two encoding methods termed Multi-Scale Fisher Vector (MSFV) and Temporal Sparse Coding based Fisher Vector Coding (TSCFVC) to form global representations of depth sequences. The high-dimensional action descriptors resulted from the two encoding methods are fed to a linear SVM for efficient action classification. Our proposed methods are evaluated on two public benchmark datasets, MSRAction3D and MSRGesture3D. The experimental result shows the effectiveness of the proposed methods on both the datasets.
Document type :
Conference papers
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://hal.inria.fr/hal-01409021
Contributor : François Charpillet <>
Submitted on : Monday, December 5, 2016 - 3:59:00 PM
Last modification on : Tuesday, December 18, 2018 - 4:40:22 PM
Long-term archiving on : Monday, March 20, 2017 - 6:32:13 PM

File

ICPR_manuscript.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01409021, version 1

Citation

Xuan Nguyen, Thanh Nguyen, François Charpillet. Effective Surface Normals Based Action Recognition in Depth Images. ICPR 2016 - 23rd International Conference on Pattern Recognition , Dec 2016, Cancun, Mexico. ⟨hal-01409021⟩

Share

Metrics

Record views

265

Files downloads

179