Bio-inspired motion estimation – From modelling to evaluation, can biology be a source of inspiration?

Émilien Tlapale 1, * Pierre Kornprobst 1 Guillaume Masson 2 Olivier Faugeras 1 Jan Bouecke 3 Heiko Neumann 3
* Auteur correspondant
1 NEUROMATHCOMP
CRISAM - Inria Sophia Antipolis - Méditerranée , INRIA Rocquencourt, ENS Paris - École normale supérieure - Paris, UNS - Université Nice Sophia Antipolis, CNRS - Centre National de la Recherche Scientifique : UMR8548
Abstract : We propose a bio-inspired approach to motion estimation based on recent neuroscience findings concerning the motion pathway. Our goal is to identify the key biological features in order to reach a good compromise between bio-inspiration and computational efficiency. Here we choose the neural field formalism which provides a sound mathematical framework to describe the model at a macroscopic scale. Within this framework we define the cortical activity as coupled integro-differential equations and we prove the well-posedness of the model. We show how our model performs on some classical computer vision videos, and we compare its behaviour against the visual system on a simple classical video used in psychophysics. Following this idea, we propose a new benchmark to evaluate models against visual system performance. Baseline results are provided for both bio-inspired and computer vision models. Results confirm the good performance of recent computer vision approaches even on such synthetic stimuli, and also show that taking biology into account in models can improve performance. As a whole, this article affords a considerable insight into how biology can bring new ideas in computer vision at different levels: modelling principles, mathematical formalism and evaluation methodology. Perspectives around this work are promising and cover the addition of delays to constrain propagation as well as the extension of our benchmark to better characterise the visual system performance.
Type de document :
Rapport
[Research Report] RR-7447, INRIA. 2010
Liste complète des métadonnées

Littérature citée [79 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00532894
Contributeur : Émilien Tlapale <>
Soumis le : lundi 8 novembre 2010 - 13:07:34
Dernière modification le : mercredi 10 octobre 2018 - 20:30:03
Document(s) archivé(s) le : jeudi 30 mars 2017 - 02:40:20

Fichier

RR-7447.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00532894, version 2

Citation

Émilien Tlapale, Pierre Kornprobst, Guillaume Masson, Olivier Faugeras, Jan Bouecke, et al.. Bio-inspired motion estimation – From modelling to evaluation, can biology be a source of inspiration?. [Research Report] RR-7447, INRIA. 2010. 〈inria-00532894v2〉

Partager

Métriques

Consultations de la notice

678

Téléchargements de fichiers

299