HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Extracting Action Sensitive Features to Facilitate Weakly-Supervised Action Localization

Abstract : Weakly-supervised temporal action localization has attracted much attention among researchers in video content analytics, thanks to its relaxed requirements of video-level annotations instead of frame-level labels. However, many current weakly-supervised action localization methods depend heavily on naive feature combination and empirical thresholds to determine temporal action boundaries, which is practically feasible but could still be sub-optimal. Inspired by the momentum term, we propose a general-purpose action recognition criterion that replaces explicit empirical thresholds. Based on such criterion, we analyze different combination of streams and propose the Action Sensitive Extractor (ASE) that produces action sensitive features. Our ASE sets temporal stream as main stream and extends with complementary spatial streams. We build our Action Sensitive Network (ASN) and evaluate on THUMOS14 and ActivityNet1.2 with different selection method. Our network yields state-of-art performance in both datasets.
Document type :
Conference papers
Complete list of metadata

Cited literature [43 references]  Display  Hide  Download

https://hal.inria.fr/hal-02331300
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Thursday, October 24, 2019 - 12:50:08 PM
Last modification on : Wednesday, June 10, 2020 - 10:00:04 AM
Long-term archiving on: : Saturday, January 25, 2020 - 3:34:33 PM

File

483292_1_En_15_Chapter.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Zijian Kang, Le Wang, Ziyi Liu, Qilin Zhang, Nanning Zheng. Extracting Action Sensitive Features to Facilitate Weakly-Supervised Action Localization. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Hersonissos, Greece. pp.188-201, ⟨10.1007/978-3-030-19823-7_15⟩. ⟨hal-02331300⟩

Share

Metrics

Record views

34

Files downloads

1