Skip to Main content Skip to Navigation
Journal articles

Improving bag-of-poses with semi-temporal pose descriptors for skeleton-based action recognition

Abstract : Over the last few decades, human action recognition has become one of the most challenging tasks in the field of computer vision. Employing economical depth sensors such as Microsoft Kinect as well as recent successes of deep learning approaches in image understanding has led to effortless and accurate extraction of 3D skeleton information. In this study, we have introduced a novel bag-of-poses framework for action recognition by exploiting 3D skeleton data. Our assumption is that any action can be represented with a set of predefined spatiotemporal poses. The pose de-scriptor is composed of two parts, the first part is concatena-tion of the normalized coordinate of the skeleton joints. The second part consists of temporal displacement of the joints which is constructed with predefined temporal offset. In order to generate the key poses, we apply K-means clustering overall training pose descriptors of dataset. To classify an action pose, we train a SVM classifier with the generated key poses. Thereby, every action on dataset is encoded with key-poses histogram. We use ELM classifier to recognize the actions since it has been shown to be faster, accurate , and more reliable than other classifiers. The proposed framework is validated with four publicly available benchmark 3D action datasets. The results show that our frame-2 Saeid Agahian et al. work achieves state-of-the-art results on three of the datasets compared to the other methods and produces competitive result on the fourth.
Document type :
Journal articles
Complete list of metadatas

Cited literature [68 references]  Display  Hide  Download

https://hal.inria.fr/hal-01849283
Contributor : Farhood Negin <>
Submitted on : Wednesday, July 25, 2018 - 6:34:09 PM
Last modification on : Wednesday, September 18, 2019 - 10:50:03 AM
Long-term archiving on: : Friday, October 26, 2018 - 4:23:05 PM

File

final.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Farhood Negin, Saeid Agahian, Cemal Köse. Improving bag-of-poses with semi-temporal pose descriptors for skeleton-based action recognition. Visual Computer, Springer Verlag, 2018, ⟨10.1007/s00371-018-1489-7⟩. ⟨hal-01849283⟩

Share

Metrics

Record views

392

Files downloads

410