Skip to Main content Skip to Navigation
Conference papers

PDAN: Pyramid Dilated Attention Network for Action Detection

Abstract : Handling long and complex temporal information is an important challenge for action detection tasks. This challenge is further aggravated by densely distributed actions in untrimmed videos. Previous action detection methods fail in selecting the key temporal information in long videos. To this end, we introduce the Dilated Attention Layer (DAL). Compared to previous temporal convolution layer, DAL allocates attentional weights to local frames in the kernel, which enables it to learn better local representation across time. Furthermore, we introduce Pyramid Dilated Attention Network (PDAN) which is built upon DAL. With the help of multiple DALs with different dilation rates, PDAN can model short-term and long-term temporal relations simultaneously by focusing on local segments at the level of low and high temporal receptive fields. This property enables PDAN to handle complex temporal relations between different action instances in long untrimmed videos. To corroborate the effectiveness and robustness of our method, we evaluate it on three densely annotated, multi-label datasets: MultiTHUMOS, Charades and Toyota Smarthome Untrimmed (TSU) dataset. PDAN is able to outperform previous state-of-the-art methods on all these datasets.
Document type :
Conference papers
Complete list of metadata
Contributor : Rui Dai Connect in order to contact the contributor
Submitted on : Thursday, November 26, 2020 - 4:11:10 PM
Last modification on : Tuesday, September 21, 2021 - 3:35:44 AM
Long-term archiving on: : Saturday, February 27, 2021 - 7:48:12 PM


Files produced by the author(s)


  • HAL Id : hal-03026308, version 1



Rui Dai, Srijan Das, Luca Minciullo, Lorenzo Garattoni, Gianpiero Francesca, et al.. PDAN: Pyramid Dilated Attention Network for Action Detection. WACV 2021 - Winter Conference on Applications of Computer Vision 2021, Jan 2021, Waikoloa / Virtual, United States. ⟨hal-03026308⟩



Les métriques sont temporairement indisponibles