On-line learning of activities from video

Luis Patino 1 François Bremond 1 Monique Thonnat 1
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : The present work introduces a new method for activity extraction from video. To achieve this, we focus on the modelling of context by developing an algorithm that automatically learns the main activity zones of the observed scene by taking as input the trajectories of detected mobiles. Automatically learning the context of the scene (activity zones) allows first to extract a knowledge on the occupancy of the different areas of the scene. In a second step, learned zones are employed to extract people activities by relating mobile trajectories to the learned zones, in this way, the activity of a person can be summarised as the series of zones that the person has visited. For the analysis of the trajectory, a multi resolution analysis is set such that a trajectory is segmented into a series of tracklets based on changing speed points thus allowing differentiating when people stop to interact with elements of the scene or other persons. Tracklets allow thus to extract behavioural information. Starting and ending tracklet points are fed to a simple yet advantageous incremental clustering algorithm to create an initial partition of the scene. Similarity relations between resulting clusters are modelled employing fuzzy relations. These can then be aggregated with typical soft-computing algebra. A clustering algorithm based on the transitive closure calculation of the fuzzy relations allows building the final structure of the scene. To allow for incremental learning and update of activity zones (and thus people activities), fuzzy relations are defined with on-line learning terms. We present results obtained on real videos from different activity domains.
Type de document :
Communication dans un congrès
AVSS - IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance 2012, Sep 2012, Beijing, China. IEEE, pp.234-239, 2012, 〈10.1109/AVSS.2012.50〉
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00761461
Contributeur : Monique Thonnat <>
Soumis le : mercredi 5 décembre 2012 - 15:22:52
Dernière modification le : jeudi 11 janvier 2018 - 16:22:57
Document(s) archivé(s) le : mercredi 6 mars 2013 - 07:15:07

Fichier

LuisAVSS2012-2.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Luis Patino, François Bremond, Monique Thonnat. On-line learning of activities from video. AVSS - IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance 2012, Sep 2012, Beijing, China. IEEE, pp.234-239, 2012, 〈10.1109/AVSS.2012.50〉. 〈hal-00761461〉

Partager

Métriques

Consultations de la notice

299

Téléchargements de fichiers

142