Skip to Main content Skip to Navigation
New interface
Journal articles

What can we expect from a V1-MT feedforward architecture for optical flow estimation?

Abstract : Motion estimation has been studied extensively in neuroscience in the last two decades. Even though there has been some early interaction between the biological and computer vision communities at a modelling level, comparatively little work has been done on the examination or extension of the biological models in terms of their engineering efficacy on modern optical flow estimation datasets. An essential contribution of this paper is to show how a neural model can be enriched to deal with real sequences. We start from a classical V1-MT feedforward architecture. We model V1 cells by motion energy (based on spatio-temporal filtering), and MT pattern cells (by pooling V1 cell responses). The efficacy of this architecture and its inherent limitations in the case of real videos are not known. To answer this question, we propose a velocity space sampling of MT neurons (using a decoding scheme to obtain the local velocity from their activity) coupled with a multi-scale approach. After this, we explore the performance of our model on the Middlebury dataset. To the best of our knowledge, this is the only neural model in this dataset. The results are promising and suggest several possible improvements, in particular to better deal with discontinuities. Overall, this work provides a baseline for future developments of bio-inspired scalable computer vision algorithms and the code is publicly available to encourage research in this direction. & 2015 Published by Elsevier B.V.
Complete list of metadata

Cited literature [26 references]  Display  Hide  Download
Contributor : Pierre Kornprobst Connect in order to contact the contributor
Submitted on : Tuesday, October 20, 2015 - 2:28:02 PM
Last modification on : Friday, November 25, 2022 - 6:50:05 PM
Long-term archiving on: : Friday, April 28, 2017 - 5:52:21 AM


Files produced by the author(s)



Fabio Solari, Manuela Chessa, N. V. Kartheek Medathati, Pierre Kornprobst. What can we expect from a V1-MT feedforward architecture for optical flow estimation?. Signal Processing: Image Communication, 2015, ⟨10.1016/j.image.2015.04.006⟩. ⟨hal-01215519⟩



Record views


Files downloads