FUSION FRAMEWORK FOR VIDEO EVENT RECOGNITION

Abstract : This paper presents a multisensor fusion framework for video activities recognition based on statistical reasoning and D-S evidence theory. Precisely, the framework consists in the combination of the events' uncertainty computation with the trained database and the fusion method based on the conflict management of evidences. Our framework aims to build Multisensor fusion architecture for event recognition by combining sensors, dealing with conflicting recognition, and improving their performance. According to a complex event's hierarchy, Primitive state is chosen as our target event in the framework. A RGB camera and a RGB-D camera are used to recognise a person's basic activities in the scene. The main convenience of the proposed framework is that it firstly allows adding easily more possible events into the system with a complete structure for handling uncertainty. And secondly, the inference of Dempster-Shafer theory resembles human perception and fits for uncertainty and conflict management with incomplete information. The cross-validation of real-world data (10 persons) is carried out using the proposed framework, and the evaluation shows promising results that the fusion approach has an average sensitivity of 93.31% and an average precision of 86.7%. These results are better than the ones when only one camera is used, encouraging further research focusing on the combination of more sensors with more events, as well as the optimization of the parameters in the framework for improvements.
Document type :
Conference papers
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/hal-00784725
Contributor : Carlos Fernando Crispim-Junior <>
Submitted on : Monday, February 4, 2013 - 3:33:14 PM
Last modification on : Thursday, February 7, 2019 - 3:03:58 PM
Long-term archiving on : Sunday, May 5, 2013 - 9:00:14 AM

File

final-submit-Fusion_Framework_...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00784725, version 1

Collections

Citation

Qiao Ma, Baptiste Fosty, Carlos Fernando Crispim-Junior, François Bremond. FUSION FRAMEWORK FOR VIDEO EVENT RECOGNITION. The 10th IASTED International Conference on Signal Processing, Pattern Recognition and Applications, The International Association of Science and Technology for Development (IASTED), Feb 2013, Innsbruck, Austria. ⟨hal-00784725⟩

Share

Metrics

Record views

382

Files downloads

278