Skip to Main content Skip to Navigation
New interface
Conference papers

Improving Surface Normals Based Action Recognition in Depth Images

Xuan Son Nguyen 1 Thanh Phuong Nguyen 2 François Charpillet 1 
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : In this paper, we propose a new local descriptor for action recognition in depth images. Our proposed descrip-tor jointly encodes the shape and motion cues using surface normals in 4D space of depth, time, spatial coordinates and higher-order partial derivatives of depth values along spatial coordinates. In a traditional Bag-of-words (BoW) approach, local descriptors extracted from a depth sequence are encoded to form a global representation of the sequence. In our approach, local descriptors are encoded using Sparse Coding (SC) and Fisher Vector (FV), which have been recently proven effective for action recognition. Action recognition is then simply performed using a linear SVM classifier. Our proposed action descriptor is evaluated on two public benchmark datasets, MSRAction3D and MSRGesture3D. The experimental result shows the effectiveness of the proposed method on both the datasets.
Document type :
Conference papers
Complete list of metadata

Cited literature [33 references]  Display  Hide  Download
Contributor : François Charpillet Connect in order to contact the contributor
Submitted on : Tuesday, December 6, 2016 - 9:07:04 AM
Last modification on : Monday, July 25, 2022 - 3:44:07 AM
Long-term archiving on: : Tuesday, March 21, 2017 - 2:33:51 AM


Files produced by the author(s)


  • HAL Id : hal-01409043, version 1


Xuan Son Nguyen, Thanh Phuong Nguyen, François Charpillet. Improving Surface Normals Based Action Recognition in Depth Images. 13th International Conference on Advanced Video and Signal-Based Surveillance, Aug 2016, Colorado Springs, United States. ⟨hal-01409043⟩



Record views


Files downloads