Discriminative Spatial Saliency for Image Classification

Gaurav Sharma 1, 2 Frédéric Jurie 1, 3 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
3 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : In many visual classification tasks the spatial distribution of discriminative information is (i) non uniform e.g. person 'reading' can be distinguished from 'taking a photo' based on the area around the arms i.e. ignoring the legs and (ii) has intra class variations e.g. different readers may hold the books differently. Motivated by these observations, we propose to learn the discriminative spatial saliency of images while simultaneously learning a max margin classifier for a given visual classification task. Using the saliency maps to weight the corresponding visual features improves the discriminative power of the image representation. We treat the saliency maps as latent variables and allow them to adapt to the image content to maximize the classification score, while regularizing the change in the saliency maps. Our experimental results on three challenging datasets, for (i) human action classification, (ii) fine grained classification and (iii) scene classification, demonstrate the effectiveness and wide applicability of the method.
Type de document :
Communication dans un congrès
CVPR 2012 - Conference on Computer Vision and Pattern Recognition, Jun 2012, Providence, Rhode Island, United States. IEEE, pp.3506-3513, 2012, 〈10.1109/CVPR.2012.6248093〉
Liste complète des métadonnées

Littérature citée [32 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-00714311
Contributeur : Thoth Team <>
Soumis le : mercredi 4 juillet 2012 - 00:07:31
Dernière modification le : mardi 5 juin 2018 - 18:00:02
Document(s) archivé(s) le : vendredi 5 octobre 2012 - 02:19:05

Fichiers

1059.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Gaurav Sharma, Frédéric Jurie, Cordelia Schmid. Discriminative Spatial Saliency for Image Classification. CVPR 2012 - Conference on Computer Vision and Pattern Recognition, Jun 2012, Providence, Rhode Island, United States. IEEE, pp.3506-3513, 2012, 〈10.1109/CVPR.2012.6248093〉. 〈hal-00714311〉

Partager

Métriques

Consultations de la notice

1168

Téléchargements de fichiers

1224