Skip to Main content Skip to Navigation
Journal articles

CuDi3D: Curvilinear displacement based approach for online 3D action detection

Said Yacine Boulahia 1, 2, * Eric Anquetil 1, 2 Franck Multon 3, 4 Richard Kulpa 3, 4
* Corresponding author
1 IntuiDoc - intuitive user interaction for document
3 MIMETIC - Analysis-Synthesis Approach for Virtual Human Simulation
UR2 - Université de Rennes 2, IRISA-D6 - MEDIA ET INTERACTIONS, Inria Rennes – Bretagne Atlantique
Abstract : Being able to interactively detect and recognize 3D actions based on skeleton data, in unsegmented streams, has become an important computer vision topic. It raises three scientific problems in relation with variability. The first one is the temporal variability that occurs when subjects perform gestures with different speeds. The second one is the inter-class spatial variability, which refers to disparities between the displacement amounts induced by different classes (i.e. long vs. short movements). The last one is the intra-class spatial variability caused by differences in style and gesture amplitude. In this paper, we design an original approach that better considers these three issues. To address temporal variability we introduce the notion of curvilinear segmentation. It consists in extracting features, not on temporally-based sliding windows, but on trajectory segments for which the cumulated displacement equals a class-based amount. Second, to tackle inter-class spatial variability, we define several competing classifiers with their dedicated curvilinear windows. Last, we address intra-class spatial variability by designing a fusion system that takes the decisions and confidence scores of every competing classifier into account. Extensive experiments on four challenging skeleton-based datasets demonstrate the relevance of the proposed approach for action recognition and online action detection.
Complete list of metadata

Cited literature [45 references]  Display  Hide  Download
Contributor : Franck Multon Connect in order to contact the contributor
Submitted on : Tuesday, September 4, 2018 - 5:40:16 PM
Last modification on : Wednesday, November 3, 2021 - 8:16:22 AM
Long-term archiving on: : Wednesday, December 5, 2018 - 5:48:51 PM


Files produced by the author(s)



Said Yacine Boulahia, Eric Anquetil, Franck Multon, Richard Kulpa. CuDi3D: Curvilinear displacement based approach for online 3D action detection. Computer Vision and Image Understanding, Elsevier, 2018, 174, pp.57-69. ⟨10.1016/j.cviu.2018.07.003⟩. ⟨hal-01856894⟩



Record views


Files downloads