What can we expect from a classical V1-MT feedforward architecture for optical flow estimation?

Abstract : Motion estimation has been studied extensively in neurosciences in the last two decades. The general consensus that has evolved from the studies in the primate vision is that it is done in a two stage process involving cortical areas V1 and MT in the brain. Spatio temporal filters are leading contenders in terms of models that capture the characteristics exhibited in these areas. Even though there are many models in the biological vision literature covering the optical flow estimation problem based on the spatio-temporal filters little is known in terms of their performance on the modern day computer vision datasets such as Middlebury. In this paper, we start from a mostly classical feedforward V1-MT model introducing a additional decoding step to obtain an optical flow estimation. Two extensions are also discussed using nonlinear filtering of the MT response for a better handling of discontinuities. One essential contribution of this paper is to show how a neural model can be adapted to deal with real sequences and it is here for the first time that such a neural model is benchmarked on the modern computer vision dataset Middlebury. Results are promising and suggest several possible improvements. \code{We think that this work could act as a good starting point for building bio-inspired scalable computer vision algorithms. For that reason we propose to also share the code in order to encourage research in this direction.
Type de document :
Rapport
[Research Report] RR-8618, INRIA Sophia Antipolis; University of Genoa - DIBRIS, Italy; INRIA. 2014, pp.22
Liste complète des métadonnées

Littérature citée [38 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01078117
Contributeur : Pierre Kornprobst <>
Soumis le : mardi 28 octobre 2014 - 09:04:27
Dernière modification le : jeudi 3 mai 2018 - 13:32:58
Document(s) archivé(s) le : jeudi 29 janvier 2015 - 10:16:21

Fichier

RR-8618.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01078117, version 1

Citation

Fabio Solari, Manuela Chessa, Kartheek Medathati, Pierre Kornprobst. What can we expect from a classical V1-MT feedforward architecture for optical flow estimation?. [Research Report] RR-8618, INRIA Sophia Antipolis; University of Genoa - DIBRIS, Italy; INRIA. 2014, pp.22. 〈hal-01078117〉

Partager

Métriques

Consultations de la notice

437

Téléchargements de fichiers

471