Skip to Main content Skip to Navigation
New interface
Conference papers

Discriminative Spatial Saliency for Image Classification

Gaurav Sharma 1, 2 Frédéric Jurie 1, 3 Cordelia Schmid 1 
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
3 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image et Instrumentation de Caen
Abstract : In many visual classification tasks the spatial distribution of discriminative information is (i) non uniform e.g. person 'reading' can be distinguished from 'taking a photo' based on the area around the arms i.e. ignoring the legs and (ii) has intra class variations e.g. different readers may hold the books differently. Motivated by these observations, we propose to learn the discriminative spatial saliency of images while simultaneously learning a max margin classifier for a given visual classification task. Using the saliency maps to weight the corresponding visual features improves the discriminative power of the image representation. We treat the saliency maps as latent variables and allow them to adapt to the image content to maximize the classification score, while regularizing the change in the saliency maps. Our experimental results on three challenging datasets, for (i) human action classification, (ii) fine grained classification and (iii) scene classification, demonstrate the effectiveness and wide applicability of the method.
Complete list of metadata

Cited literature [32 references]  Display  Hide  Download
Contributor : THOTH Team Connect in order to contact the contributor
Submitted on : Wednesday, July 4, 2012 - 12:07:31 AM
Last modification on : Saturday, June 25, 2022 - 9:46:54 AM
Long-term archiving on: : Friday, October 5, 2012 - 2:19:05 AM


Files produced by the author(s)



Gaurav Sharma, Frédéric Jurie, Cordelia Schmid. Discriminative Spatial Saliency for Image Classification. CVPR 2012 - Conference on Computer Vision and Pattern Recognition, Jun 2012, Providence, Rhode Island, United States. pp.3506-3513, ⟨10.1109/CVPR.2012.6248093⟩. ⟨hal-00714311⟩



Record views


Files downloads