Discriminative Spatial Saliency for Image Classification

Gaurav Sharma 1, 2 Frédéric Jurie 1, 3 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
3 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : In many visual classification tasks the spatial distribution of discriminative information is (i) non uniform e.g. person 'reading' can be distinguished from 'taking a photo' based on the area around the arms i.e. ignoring the legs and (ii) has intra class variations e.g. different readers may hold the books differently. Motivated by these observations, we propose to learn the discriminative spatial saliency of images while simultaneously learning a max margin classifier for a given visual classification task. Using the saliency maps to weight the corresponding visual features improves the discriminative power of the image representation. We treat the saliency maps as latent variables and allow them to adapt to the image content to maximize the classification score, while regularizing the change in the saliency maps. Our experimental results on three challenging datasets, for (i) human action classification, (ii) fine grained classification and (iii) scene classification, demonstrate the effectiveness and wide applicability of the method.
Complete list of metadatas

Cited literature [32 references]  Display  Hide  Download


https://hal.inria.fr/hal-00714311
Contributor : Thoth Team <>
Submitted on : Wednesday, July 4, 2012 - 12:07:31 AM
Last modification on : Thursday, February 7, 2019 - 5:27:52 PM
Long-term archiving on : Friday, October 5, 2012 - 2:19:05 AM

Files

1059.pdf
Files produced by the author(s)

Identifiers

Citation

Gaurav Sharma, Frédéric Jurie, Cordelia Schmid. Discriminative Spatial Saliency for Image Classification. CVPR 2012 - Conference on Computer Vision and Pattern Recognition, Jun 2012, Providence, Rhode Island, United States. pp.3506-3513, ⟨10.1109/CVPR.2012.6248093⟩. ⟨hal-00714311⟩

Share

Metrics

Record views

1228

Files downloads

1430