Spatial Fisher Vectors for Image Categorization

Josip Krapac 1 Jakob Verbeek 1 Frédéric Jurie 1, 2
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : We introduce an extension of bag-of-words image representations to encode spatial layout. Using the Fisher kernel framework we derive a representation that encodes the spatial mean and the variance of image regions associated with visual words. We extend this representation by using a Gaussian mixture model to encode spatial layout, and show that this model is related to a soft-assign version of the spatial pyramid representation. We also combine our representation of spatial layout with the use of Fisher kernels to encode the appearance of local features. Through an extensive experimental evaluation, we show that our representation yields state-of-the-art image categorization results, while being more compact than spatial pyramid representations. In particular, using Fisher kernels to encode both appearance and spatial layout results in an image representation that is computationally efficient, compact, and yields excellent performance while using linear classifiers.
Type de document :
Rapport
[Research Report] RR-7680, INRIA. 2011
Liste complète des métadonnées

Littérature citée [31 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00613572
Contributeur : Jakob Verbeek <>
Soumis le : jeudi 4 août 2011 - 17:28:56
Dernière modification le : mardi 5 juin 2018 - 18:00:02
Document(s) archivé(s) le : lundi 12 novembre 2012 - 15:10:27

Fichiers

RR-7680.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

  • HAL Id : inria-00613572, version 1

Citation

Josip Krapac, Jakob Verbeek, Frédéric Jurie. Spatial Fisher Vectors for Image Categorization. [Research Report] RR-7680, INRIA. 2011. 〈inria-00613572〉

Partager

Métriques

Consultations de la notice

996

Téléchargements de fichiers

1452