Skip to Main content Skip to Navigation
New interface
Conference papers

On-line learning of activities from video

Luis Patino 1 François Bremond 1 Monique Thonnat 1 
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : The present work introduces a new method for activity extraction from video. To achieve this, we focus on the modelling of context by developing an algorithm that automatically learns the main activity zones of the observed scene by taking as input the trajectories of detected mobiles. Automatically learning the context of the scene (activity zones) allows first to extract a knowledge on the occupancy of the different areas of the scene. In a second step, learned zones are employed to extract people activities by relating mobile trajectories to the learned zones, in this way, the activity of a person can be summarised as the series of zones that the person has visited. For the analysis of the trajectory, a multi resolution analysis is set such that a trajectory is segmented into a series of tracklets based on changing speed points thus allowing differentiating when people stop to interact with elements of the scene or other persons. Tracklets allow thus to extract behavioural information. Starting and ending tracklet points are fed to a simple yet advantageous incremental clustering algorithm to create an initial partition of the scene. Similarity relations between resulting clusters are modelled employing fuzzy relations. These can then be aggregated with typical soft-computing algebra. A clustering algorithm based on the transitive closure calculation of the fuzzy relations allows building the final structure of the scene. To allow for incremental learning and update of activity zones (and thus people activities), fuzzy relations are defined with on-line learning terms. We present results obtained on real videos from different activity domains.
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download
Contributor : Monique Thonnat Connect in order to contact the contributor
Submitted on : Wednesday, December 5, 2012 - 3:22:52 PM
Last modification on : Saturday, June 25, 2022 - 11:09:01 PM
Long-term archiving on: : Wednesday, March 6, 2013 - 7:15:07 AM


Files produced by the author(s)




Luis Patino, François Bremond, Monique Thonnat. On-line learning of activities from video. AVSS - IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance 2012, Sep 2012, Beijing, China. pp.234-239, ⟨10.1109/AVSS.2012.50⟩. ⟨hal-00761461⟩



Record views


Files downloads