FUSION FRAMEWORK FOR VIDEO EVENT RECOGNITION

Abstract : This paper presents a multisensor fusion framework for video activities recognition based on statistical reasoning and D-S evidence theory. Precisely, the framework consists in the combination of the events' uncertainty computation with the trained database and the fusion method based on the conflict management of evidences. Our framework aims to build Multisensor fusion architecture for event recognition by combining sensors, dealing with conflicting recognition, and improving their performance. According to a complex event's hierarchy, Primitive state is chosen as our target event in the framework. A RGB camera and a RGB-D camera are used to recognise a person's basic activities in the scene. The main convenience of the proposed framework is that it firstly allows adding easily more possible events into the system with a complete structure for handling uncertainty. And secondly, the inference of Dempster-Shafer theory resembles human perception and fits for uncertainty and conflict management with incomplete information. The cross-validation of real-world data (10 persons) is carried out using the proposed framework, and the evaluation shows promising results that the fusion approach has an average sensitivity of 93.31% and an average precision of 86.7%. These results are better than the ones when only one camera is used, encouraging further research focusing on the combination of more sensors with more events, as well as the optimization of the parameters in the framework for improvements.
Type de document :
Communication dans un congrès
The 10th IASTED International Conference on Signal Processing, Pattern Recognition and Applications, Feb 2013, Innsbruck, Austria. 2013
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00784725
Contributeur : Carlos Crispim <>
Soumis le : lundi 4 février 2013 - 15:33:14
Dernière modification le : jeudi 11 janvier 2018 - 16:20:00
Document(s) archivé(s) le : dimanche 5 mai 2013 - 09:00:14

Fichier

final-submit-Fusion_Framework_...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00784725, version 1

Collections

Citation

Qiao Ma, Baptiste Fosty, Carlos Fernando Crispim-Junior, François Bremond. FUSION FRAMEWORK FOR VIDEO EVENT RECOGNITION. The 10th IASTED International Conference on Signal Processing, Pattern Recognition and Applications, Feb 2013, Innsbruck, Austria. 2013. 〈hal-00784725〉

Partager

Métriques

Consultations de la notice

280

Téléchargements de fichiers

176