Deep learning for action and gesture recognition in image sequences: a survey

Abstract : Interest in automatic action and gesture recognition has grown considerably in the last few years. This is due in part to the large number of application domains for this type of technology. As in many other computer vision areas, deep learning based methods have quickly become a reference methodology for obtaining state-of-the-art performance in both tasks. This chapter is a survey of current deep learning based methodologies for action and gesture recognition in sequences of images. The survey reviews both fundamental and cutting edge methodologies reported in the last few years. We introduce a taxonomy that summarizes important aspects of deep learning for approaching both tasks. Details of the proposed architectures, fusion strategies, main datasets, and competitions are reviewed. Also, we summarize and discuss the main works proposed so far with particular interest on how they treat the temporal dimension of data, their highlighting features, and opportunities and challenges for future research. To the best of our knowledge this is the first survey in the topic. We foresee this survey will become a reference in this ever dynamic field of research.
Complete list of metadatas

Cited literature [182 references]  Display  Hide  Download

https://hal.inria.fr/hal-01678006
Contributor : Isabelle Guyon <>
Submitted on : Monday, January 8, 2018 - 6:00:08 PM
Last modification on : Thursday, February 7, 2019 - 3:43:07 PM
Long-term archiving on : Saturday, May 5, 2018 - 9:29:13 AM

File

deep_learning_action.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01678006, version 1

Citation

Maryam Asadi-Aghbolaghi, Albert Clapes, Marco Bellantonio, Hugo Escalante, Víctor Ponce-López, et al.. Deep learning for action and gesture recognition in image sequences: a survey . Gesture Recognition, Springer Verlag, pp.539-578, 2017. ⟨hal-01678006⟩

Share

Metrics

Record views

563

Files downloads

6804