Skip to Main content Skip to Navigation

Hierarchical motion-based video analysis with applications to video post-production.

Abstract : The manuscript that is presented here contains all the findings and conclusions of the carried research in dynamic visual scene analysis. To be precise, we consider the ubiquitous monocular camera computer vision set-up, and the natural unconstrained videos that can be produced by it. In particular, we focus on important problems that are of general interest for the computer vision literature, and of special interest for the film industry, in the context of the video post-production pipeline. The tackled problems can be grouped in two main categories, according to the whether they are driven user interaction or not : user-assisted video processing tools and unsupervised tools for video analysis. This division is rather synthetic but it is in fact related to the ways the proposed methods are used inside the video post-production pipeline. These groups correspond to the main parts that form this manuscript, which are subsequently formed by chapters that explain our proposed methods. However, a single thread ties together all of our findings. This is, a hierarchical analysis of motion composition in dynamic scenes. We explain our exact contributions, together with our main motivations, and results in the following sections. We depart from a hypothesis that links the ability to consider a hierarchical structure of scene motion, with a deeper level of dynamic scene understanding. This hypothesis is inspired by plethora of scientific research in biological and psychological vision. More specifically, we refer to the biological vision research that established the presence of motion-related sensory units in the visual cortex. The discovery of these specialized brain units motivated psychological vision researchers to investigate how animal locomotion (obstacle avoidance, path planning, self-localization) and other higher-level tasks are directly influenced by motion-related percepts. Interestingly, the perceptual responses that take place in the visual cortex are activated not only by motion itself, but by occlusions, dis-occlusions, motion composition, and moving edges. Furthermore, psychological vision have linked the brain's ability to understand motion composition from visual information to high level scene understanding like object segmentation and recognition.
Mots-clés : Video Analysis
Complete list of metadata

Cited literature [281 references]  Display  Hide  Download
Contributor : Juan-Manuel Perez-Rua Connect in order to contact the contributor
Submitted on : Tuesday, November 13, 2018 - 4:43:43 PM
Last modification on : Friday, October 23, 2020 - 4:40:03 PM


Files produced by the author(s)


  • HAL Id : tel-01921234, version 1



Juan-Manuel Perez-Rua. Hierarchical motion-based video analysis with applications to video post-production.. Computer Science [cs]. Universite de Rennes 1, 2017. English. ⟨tel-01921234⟩



Record views


Files downloads