Hyperfeatures - multilevel local coding for visual recognition

Ankur Agarwal 1 Bill Triggs 1
1 LEAR - Learning and recognition in vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : Histograms of local appearance descriptors are a popular representation for visual recognition. They are highly discriminant and have good resistance to local occlusions and to geometric and photometric variations, but they are not able to exploit spatial co-occurrence statistics at scales larger than their local input patches. We present a new multilevel visual representation, ‘hyperfeatures', that is designed to remedy this. The starting point is the familiar notion that to detect object parts, in practice it often suffices to detect co-occurrences of more local object fragments – a process that can be formalized as comparison (e.g. vector quantization) of image patches against a codebook of known fragments, followed by local aggregation of the resulting codebook membership vectors to detect co-occurrences. This process converts local collections of image descriptor vectors into somewhat less local histogram vectors – higher-level but spatially coarser descriptors. We observe that as the output is again a local descriptor vector, the process can be iterated, and that doing so captures and codes ever larger assemblies of object parts and increasingly abstract or ‘semantic' image properties. We formulate the hyperfeatures model and study its performance under several different image coding methods including clustering based Vector Quantization, Gaussian Mixtures, and combinations of these with Latent Dirichlet Allocation. We find that the resulting high-level features provide improved performance in several object image and texture image classification tasks.
Type de document :
Communication dans un congrès
Ales Leonardis and Horst Bischof and Axel Pinz. European Conference on Computer Vision (ECCV '06), May 2006, Graz, Austria. Springer-Verlag, 3951, pp.30--43, 2006, Lecture Notes in Computer Science (LNCS). 〈http://springerlink.metapress.com/content/m044q3696t231682/〉. 〈10.1007/11744023_3〉
Liste complète des métadonnées


https://hal.inria.fr/inria-00548592
Contributeur : Thoth Team <>
Soumis le : lundi 20 décembre 2010 - 09:49:42
Dernière modification le : mercredi 11 avril 2018 - 01:56:21
Document(s) archivé(s) le : lundi 21 mars 2011 - 03:22:00

Fichiers

Identifiants

Collections

Citation

Ankur Agarwal, Bill Triggs. Hyperfeatures - multilevel local coding for visual recognition. Ales Leonardis and Horst Bischof and Axel Pinz. European Conference on Computer Vision (ECCV '06), May 2006, Graz, Austria. Springer-Verlag, 3951, pp.30--43, 2006, Lecture Notes in Computer Science (LNCS). 〈http://springerlink.metapress.com/content/m044q3696t231682/〉. 〈10.1007/11744023_3〉. 〈inria-00548592〉

Partager

Métriques

Consultations de la notice

383

Téléchargements de fichiers

689