Skip to Main content Skip to Navigation
Conference papers

Action Recognition with a Bio--Inspired Feedforward Motion Processing Model: The Richness of Center-Surround Interactions

Maria-Jose Escobar 1 Pierre Kornprobst 1 
1 ODYSSEE - Computer and biological vision
DI-ENS - Département d'informatique - ENS Paris, CRISAM - Inria Sophia Antipolis - Méditerranée , ENS-PSL - École normale supérieure - Paris, Inria Paris-Rocquencourt, ENPC - École des Ponts ParisTech
Abstract : Here we show that reproducing the functional properties of MT cells with various center--surround interactions enriches motion representation and improves the action recognition performance. To do so, we propose a simplified bio--inspired model of the motion pathway in primates: It is a feedforward model restricted to V1-MT cortical layers, cortical cells cover the visual space with a foveated structure, and more importantly, we reproduce some of the richness of center-surround interactions of MT cells. Interestingly, as observed in neurophysiology, our MT cells not only behave like simple velocity detectors, but also respond to several kinds of motion contrasts. Results show that this diversity of motion representation at the MT level is a major advantage for an action recognition task. Defining motion maps as our feature vectors, we used a standard classification method on the Weizmann database: We obtained an average recognition rate of 98.9%, which is superior to the recent results by Jhuang et al. (2007). These promising results encourage us to further develop bio--inspired models incorporating other brain mechanisms and cortical layers in order to deal with more complex videos.
Document type :
Conference papers
Complete list of metadata

Cited literature [38 references]  Display  Hide  Download
Contributor : Alain Monteil Connect in order to contact the contributor
Submitted on : Friday, October 9, 2009 - 2:45:29 PM
Last modification on : Thursday, March 17, 2022 - 10:08:29 AM
Long-term archiving on: : Tuesday, October 16, 2012 - 12:05:43 PM


Files produced by the author(s)




Maria-Jose Escobar, Pierre Kornprobst. Action Recognition with a Bio--Inspired Feedforward Motion Processing Model: The Richness of Center-Surround Interactions. European Conference on Computer Vision 2008, Oct 2008, Marseille, France. pp.186--199, ⟨10.1007/978-3-540-88693-8_14⟩. ⟨inria-00423322⟩



Record views


Files downloads