Hierarchical motion-based video analysis with applications to video post-production.

Abstract : The manuscript that is presented here contains all the findings and conclusions of the carried research in dynamic visual scene analysis. To be precise, we consider the ubiquitous monocular camera computer vision set-up, and the natural unconstrained videos that can be produced by it. In particular, we focus on important problems that are of general interest for the computer vision literature, and of special interest for the film industry, in the context of the video post-production pipeline. The tackled problems can be grouped in two main categories, according to the whether they are driven user interaction or not : user-assisted video processing tools and unsupervised tools for video analysis. This division is rather synthetic but it is in fact related to the ways the proposed methods are used inside the video post-production pipeline. These groups correspond to the main parts that form this manuscript, which are subsequently formed by chapters that explain our proposed methods. However, a single thread ties together all of our findings. This is, a hierarchical analysis of motion composition in dynamic scenes. We explain our exact contributions, together with our main motivations, and results in the following sections. We depart from a hypothesis that links the ability to consider a hierarchical structure of scene motion, with a deeper level of dynamic scene understanding. This hypothesis is inspired by plethora of scientific research in biological and psychological vision. More specifically, we refer to the biological vision research that established the presence of motion-related sensory units in the visual cortex. The discovery of these specialized brain units motivated psychological vision researchers to investigate how animal locomotion (obstacle avoidance, path planning, self-localization) and other higher-level tasks are directly influenced by motion-related percepts. Interestingly, the perceptual responses that take place in the visual cortex are activated not only by motion itself, but by occlusions, dis-occlusions, motion composition, and moving edges. Furthermore, psychological vision have linked the brain's ability to understand motion composition from visual information to high level scene understanding like object segmentation and recognition.
Mots-clés : Video Analysis
Complete list of metadatas

Cited literature [281 references]  Display  Hide  Download

https://hal.inria.fr/tel-01921234
Contributor : Juan-Manuel Perez-Rua <>
Submitted on : Tuesday, November 13, 2018 - 4:43:43 PM
Last modification on : Thursday, November 15, 2018 - 1:19:57 AM

File

PEREZ_RUA_Juan_Manuel.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-01921234, version 1

Collections

Citation

Juan-Manuel Perez-Rua. Hierarchical motion-based video analysis with applications to video post-production.. Computer Science [cs]. Universite de Rennes 1, 2017. English. ⟨tel-01921234⟩

Share

Metrics

Record views

53

Files downloads

28