Bio-inspired motion estimation – From modelling to evaluation, can biology be a source of inspiration?

Émilien Tlapale 1, * Pierre Kornprobst 1 Guillaume Masson 2 Olivier Faugeras 1 Jan Bouecke 3 Heiko Neumann 3
* Corresponding author
1 NEUROMATHCOMP
CRISAM - Inria Sophia Antipolis - Méditerranée , INRIA Rocquencourt, ENS Paris - École normale supérieure - Paris, UNS - Université Nice Sophia Antipolis, CNRS - Centre National de la Recherche Scientifique : UMR8548
Abstract : We propose a bio-inspired approach to motion estimation based on recent neuroscience findings concerning the motion pathway. Our goal is to identify the key biological features in order to reach a good compromise between bio-inspiration and computational efficiency. Here we choose the neural field formalism which provides a sound mathematical framework to describe the model at a macroscopic scale. Within this framework we define the cortical activity as coupled integro-differential equations and we prove the well-posedness of the model. We show how our model performs on some classical computer vision videos, and we compare its behaviour against the visual system on a simple classical video used in psychophysics. Following this idea, we propose a new benchmark to evaluate models against visual system performance. Baseline results are provided for both bio-inspired and computer vision models. Results confirm the good performance of recent computer vision approaches even on such synthetic stimuli, and also show that taking biology into account in models can improve performance. As a whole, this article affords a considerable insight into how biology can bring new ideas in computer vision at different levels: modelling principles, mathematical formalism and evaluation methodology. Perspectives around this work are promising and cover the addition of delays to constrain propagation as well as the extension of our benchmark to better characterise the visual system performance.
Document type :
Reports
Complete list of metadatas

Cited literature [79 references]  Display  Hide  Download

https://hal.inria.fr/inria-00532894
Contributor : Émilien Tlapale <>
Submitted on : Monday, November 8, 2010 - 1:07:34 PM
Last modification on : Wednesday, April 3, 2019 - 1:56:33 AM
Long-term archiving on : Thursday, March 30, 2017 - 2:40:20 AM

File

RR-7447.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00532894, version 2

Citation

Émilien Tlapale, Pierre Kornprobst, Guillaume Masson, Olivier Faugeras, Jan Bouecke, et al.. Bio-inspired motion estimation – From modelling to evaluation, can biology be a source of inspiration?. [Research Report] RR-7447, INRIA. 2010. ⟨inria-00532894v2⟩

Share

Metrics

Record views

709

Files downloads

419