Skip to Main content Skip to Navigation
Journal articles

The THUMOS challenge on action recognition for videos "in the wild"

Abstract : Automatically recognizing and localizing wide ranges of human actions are crucial for video understanding. Towards this goal, the THUMOS challenge was introduced in 2013 to serve as a benchmark for action recognition. Until then, video action recognition , including THUMOS challenge, had focused primarily on the classification of pre-segmented (i.e., trimmed) videos, which is an artificial task. In THUMOS 2014, we elevated action recognition to a more practical level by introducing temporally untrimmed videos. These also include 'background videos' which share similar scenes and backgrounds as action videos, but are devoid of the specific actions. The three editions of the challenge organized in 2013–2015 have made THUMOS a common benchmark for action classification and detection and the annual challenge is widely attended by teams from around the world. In this paper we describe the THUMOS benchmark in detail and give an overview of data collection and annotation procedures. We present the evaluation protocols used to quantify results in the two THUMOS tasks of action classification and temporal action detection. We also present results of submissions to the THUMOS 2015 challenge and review the participating approaches. Additionally, we include a comprehensive empirical study evaluating the differences in action recognition between trimmed and $ www.thumos.info untrimmed videos, and how well methods trained on trimmed videos generalize to untrimmed videos. We conclude by proposing several directions and improvements for future THUMOS challenges.
Complete list of metadata

Cited literature [52 references]  Display  Hide  Download

https://hal.inria.fr/hal-01431525
Contributor : Guilhem Chéron <>
Submitted on : Wednesday, January 11, 2017 - 9:01:54 AM
Last modification on : Thursday, February 25, 2021 - 9:46:04 AM
Long-term archiving on: : Wednesday, April 12, 2017 - 12:26:15 PM

File

thumosCVIU_final.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Haroon Idrees, Amir Zamir, Yu-Gang Jiang, Alex Gorban, Ivan Laptev, et al.. The THUMOS challenge on action recognition for videos "in the wild". Computer Vision and Image Understanding, Elsevier, 2016, ⟨10.1016/j.cviu.2016.10.018⟩. ⟨hal-01431525⟩

Share

Metrics

Record views

872

Files downloads

1192