Skip to Main content Skip to Navigation
Conference papers

PDAN: Pyramid Dilated Attention Network for Action Detection

Abstract : Handling long and complex temporal information is an important challenge for action detection tasks. This challenge is further aggravated by densely distributed actions in untrimmed videos. Previous action detection methods fail in selecting the key temporal information in long videos. To this end, we introduce the Dilated Attention Layer (DAL). Compared to previous temporal convolution layer, DAL allocates attentional weights to local frames in the kernel, which enables it to learn better local representation across time. Furthermore, we introduce Pyramid Dilated Attention Network (PDAN) which is built upon DAL. With the help of multiple DALs with different dilation rates, PDAN can model short-term and long-term temporal relations simultaneously by focusing on local segments at the level of low and high temporal receptive fields. This property enables PDAN to handle complex temporal relations between different action instances in long untrimmed videos. To corroborate the effectiveness and robustness of our method, we evaluate it on three densely annotated, multi-label datasets: MultiTHUMOS, Charades and Toyota Smarthome Untrimmed (TSU) dataset. PDAN is able to outperform previous state-of-the-art methods on all these datasets.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/hal-03026308
Contributor : Rui Dai <>
Submitted on : Thursday, November 26, 2020 - 4:11:10 PM
Last modification on : Thursday, January 7, 2021 - 3:40:50 AM

File

Rui_wacv2021.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03026308, version 1

Collections

Citation

Rui Dai, Srijan Das, Luca Minciullo, Lorenzo Garattoni, Gianpiero Francesca, et al.. PDAN: Pyramid Dilated Attention Network for Action Detection. WACV 2021 - Winter Conference on Applications of Computer Vision 2021, Jan 2021, Waikoloa, United States. ⟨hal-03026308⟩

Share

Metrics

Record views

49

Files downloads

121