inria-00439769, version 1
Evaluation of local spatio-temporal features for action recognition
Heng Wang 1, 2Muhammad Muneeb Ullah
a, 3Alexander Klaser
b, 1Ivan Laptev
a, 3Cordelia Schmid
a, 1
BMVC 2009 - British Machine Vision Conference (2009)
Résumé : Local space-time features have recently become a popular video representation for action recognition. Several methods for feature localization and description have been proposed in the literature and promising recognition results were demonstrated for a number of action classes. The comparison of existing methods, however, is often limited given the different experimental settings used. The purpose of this paper is to evaluate and compare previously proposed space-time features in a common experimental setup. In particular, we consider four different feature detectors and six local feature descriptors and use a standard bag-of-features SVM approach for action recognition. We investigate the performance of these methods on a total of 25 action classes distributed over three datasets with varying difficulty. Among interesting conclusions, we demonstrate that regular sampling of space-time features consistently outperforms all tested space-time interest point detectors for human actions in realistic settings. We also demonstrate a consistent ranking for the majority of methods over different datasets and discuss their advantages and limitations.
- a – INRIA
- b – CNRS
- 1 : LEAR (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
- CNRS : FR71 – CNRS : UMR5527 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)
- 2 : Pattern (LIAMA)
- CIRAD – CNRS – INRA – INRIA – Chinese Academy of Science (CAS) – Institute of Automation, Chinese Academy of Sciences
- 3 : VISTAS (INRIA - IRISA)
- INRIA – INSA Rennes – CNRS : UMR6074 – Université de Rennes 1 – École normale supérieure de Cachan - ENS Cachan
- Domaine : Informatique/Vision par ordinateur et reconnaissance de formes
- Mots-clés : descriptor – evaluation – action – recognition – classification – SVM – BOW – BOF – 3D – videos – KTH – Hollywood2 – Hollywood – UCF sports
- inria-00439769, version 1
- http://hal.inria.fr/inria-00439769
- oai:hal.inria.fr:inria-00439769
- Contributeur : Team Lear
- Soumis le : Vendredi 8 Avril 2011, 14:18:13
- Dernière modification le : Mardi 10 Avril 2012, 11:29:25







Documents associés

Exporter