Improving Surface Normals Based Action Recognition in Depth Images

Xuan Nguyen 1 Thanh Nguyen 2 François Charpillet 1
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : In this paper, we propose a new local descriptor for action recognition in depth images. Our proposed descrip-tor jointly encodes the shape and motion cues using surface normals in 4D space of depth, time, spatial coordinates and higher-order partial derivatives of depth values along spatial coordinates. In a traditional Bag-of-words (BoW) approach, local descriptors extracted from a depth sequence are encoded to form a global representation of the sequence. In our approach, local descriptors are encoded using Sparse Coding (SC) and Fisher Vector (FV), which have been recently proven effective for action recognition. Action recognition is then simply performed using a linear SVM classifier. Our proposed action descriptor is evaluated on two public benchmark datasets, MSRAction3D and MSRGesture3D. The experimental result shows the effectiveness of the proposed method on both the datasets.
Document type :
Conference papers
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/hal-01409043
Contributor : François Charpillet <>
Submitted on : Tuesday, December 6, 2016 - 9:07:04 AM
Last modification on : Tuesday, December 18, 2018 - 4:40:22 PM
Long-term archiving on : Tuesday, March 21, 2017 - 2:33:51 AM

File

AVSS2016.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01409043, version 1

Citation

Xuan Nguyen, Thanh Nguyen, François Charpillet. Improving Surface Normals Based Action Recognition in Depth Images. 13th International Conference on Advanced Video and Signal-Based Surveillance, Aug 2016, Colorado Springs, United States. ⟨hal-01409043⟩

Share

Metrics

Record views

216

Files downloads

359