Continuous Action Recognition Based on Sequence Alignment

Kaustubh Kulkarni 1 Georgios Evangelidis 1 Jan Cech 1, 2 Radu Horaud 1, *
* Corresponding author
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Continuous action recognition is more challenging than isolated recognition because classification and segmentation must be simultaneously carried out. We build on the well known dynamic time warping (DTW) framework and devise a novel visual alignment technique, namely dynamic frame warping (DFW), which performs isolated recognition based on per-frame representation of videos, and on aligning a test sequence with a model sequence. Moreover, we propose two extensions which enable to perform recognition concomitant with segmentation, namely one-pass DFW and two-pass DFW. These two methods have their roots in the domain of continuous recognition of speech and, to the best of our knowledge, their extension to continuous visual action recognition has been overlooked. We test and illustrate the proposed techniques with a recently released dataset (RAVEL) and with two public-domain datasets widely used in action recognition (Hollywood-1 and Hollywood-2). We also compare the performances of the proposed isolated and continuous recognition algorithms with several recently published methods.
Document type :
Journal articles
International Journal of Computer Vision, Springer Verlag, 2015, 112 (1), pp.90-114. 〈10.1007/s11263-014-0758-9〉
Liste complète des métadonnées

Cited literature [53 references]  Display  Hide  Download


https://hal.archives-ouvertes.fr/hal-01058732
Contributor : Team Perception <>
Submitted on : Wednesday, August 27, 2014 - 8:03:11 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:10 AM
Document(s) archivé(s) le : Friday, November 28, 2014 - 10:55:30 AM

Files

Kulkarni-IJCV-05May2014.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Kaustubh Kulkarni, Georgios Evangelidis, Jan Cech, Radu Horaud. Continuous Action Recognition Based on Sequence Alignment. International Journal of Computer Vision, Springer Verlag, 2015, 112 (1), pp.90-114. 〈10.1007/s11263-014-0758-9〉. 〈hal-01058732〉

Share

Metrics

Record views

945

Files downloads

1187