Skip to Main content Skip to Navigation
Conference papers

Online temporal detection of daily-living human activities in long untrimmed video streams

Abstract : Many approaches were proposed to solve the problem of activity recognition in short clipped videos, which achieved impressive results with hand-crafted and deep features. However, it is not practical to have clipped videos in real life, where cameras provide continuous video streams in applications such as robotics, video surveillance, and smart-homes. Here comes the importance of activity detection to help recognizing and localizing each activity happening in long videos. Activity detection can be defined as the ability to localize starting and ending of each human activity happening in the video, in addition to recognizing each activity label. A more challenging category of human activities is the daily-living activities, such as eating, reading, cooking, etc, which have low inter-class variation and environment where actions are performed are similar. In this work we focus on solving the problem of detection of daily-living activities in untrimmed video streams. We introduce new online activity detection pipeline that utilizes single sliding window approach in a novel way; the classifier is trained with sub-parts of training activities, and an online frame-level early detection is done for sub-parts of long activities during detection. Finally, a greedy Markov model based post processing algorithm is applied to remove false detection and achieve better results. We test our approaches on two daily-living datasets, DAHLIA and GAADRD, outperforming state of the art results by more than 10%.
Document type :
Conference papers
Complete list of metadata

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-01948387
Contributor : Abhijit Das <>
Submitted on : Friday, December 7, 2018 - 3:44:16 PM
Last modification on : Thursday, February 7, 2019 - 4:58:38 PM
Long-term archiving on: : Friday, March 8, 2019 - 2:53:17 PM

File

IPAS_2018.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01948387, version 1

Collections

Citation

Abhishek Goel, Abdelrahman Abubakr, Michal Koperski, Francois Bremond, Gianpiero Francesca. Online temporal detection of daily-living human activities in long untrimmed video streams. IEEE IPAS 2018, Dec 2018, Nice, France. ⟨hal-01948387⟩

Share

Metrics

Record views

209

Files downloads

192