Skip to Main content Skip to Navigation
New interface
Conference papers

Effective Surface Normals Based Action Recognition in Depth Images

Xuan Son Nguyen 1 Thanh Phuong Nguyen 2 François Charpillet 1 
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : In this paper, we propose a new local descriptor for action recognition in depth images. The proposed descriptor relies on surface normals in 4D space of depth, time, spatial coordinates and higher-order partial derivatives of depth values along spatial coordinates. In order to classify actions, we follow the traditional Bag-of-words (BoW) approach, and propose two encoding methods termed Multi-Scale Fisher Vector (MSFV) and Temporal Sparse Coding based Fisher Vector Coding (TSCFVC) to form global representations of depth sequences. The high-dimensional action descriptors resulted from the two encoding methods are fed to a linear SVM for efficient action classification. Our proposed methods are evaluated on two public benchmark datasets, MSRAction3D and MSRGesture3D. The experimental result shows the effectiveness of the proposed methods on both the datasets.
Document type :
Conference papers
Complete list of metadata

Cited literature [30 references]  Display  Hide  Download
Contributor : François Charpillet Connect in order to contact the contributor
Submitted on : Monday, December 5, 2016 - 3:59:00 PM
Last modification on : Monday, July 25, 2022 - 3:44:35 AM
Long-term archiving on: : Monday, March 20, 2017 - 6:32:13 PM


Files produced by the author(s)


  • HAL Id : hal-01409021, version 1


Xuan Son Nguyen, Thanh Phuong Nguyen, François Charpillet. Effective Surface Normals Based Action Recognition in Depth Images. ICPR 2016 - 23rd International Conference on Pattern Recognition , Dec 2016, Cancun, Mexico. ⟨hal-01409021⟩



Record views


Files downloads