Action localization with tubelets from motion

Mihir Jain 1 Jan Van Gemert 2 Hervé Jégou 1 Patrick Bouthemy 3 Cees Snoek 2
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper considers the problem of action localization, where the objective is to determine when and where certain actions appear. We introduce a sampling strategy to produce 2D+t sequences of bounding boxes, called tubelets. Compared to state-of-the-art alternatives, this drastically reduces the number of hypotheses that are likely to include the action of interest. Our method is inspired by a recent technique introduced in the context of image localization. Beyond considering this technique for the first time for videos, we revisit this strategy for 2D+t sequences obtained from super-voxels. Our sampling strategy advantageously exploits a criterion that reflects how action related motion deviates from background motion. We demonstrate the interest of our approach by extensive experiments on two public datasets: UCF Sports and MSR-II. Our approach significantly outperforms the state-of-the-art on both datasets, while restricting the search of actions to a fraction of possible bounding box sequences.
Type de document :
Communication dans un congrès
CVPR - International Conference on Computer Vision and Pattern Recognition, Jun 2014, Columbus, United States. 2014
Liste complète des métadonnées

Littérature citée [35 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00996844
Contributeur : Hervé Jégou <>
Soumis le : mardi 27 mai 2014 - 09:31:58
Dernière modification le : mercredi 16 mai 2018 - 11:23:06
Document(s) archivé(s) le : mercredi 27 août 2014 - 11:01:12

Fichier

jain_cvpr2014_tubelets.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00996844, version 1

Citation

Mihir Jain, Jan Van Gemert, Hervé Jégou, Patrick Bouthemy, Cees Snoek. Action localization with tubelets from motion. CVPR - International Conference on Computer Vision and Pattern Recognition, Jun 2014, Columbus, United States. 2014. 〈hal-00996844〉

Partager

Métriques

Consultations de la notice

709

Téléchargements de fichiers

418