Creating Efficient Codebooks for Visual Recognition

Frédéric Jurie 1 Bill Triggs 1
1 LEAR - Learning and recognition in vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : Visual codebook based quantization of robust appearance descriptors extracted from local image patches is an effective means of capturing image statistics for texture analysis and scene classification. Codebooks are usually constructed by using a method such as k-means to cluster the descriptor vectors of patches sampled either densely ('textons') or sparsely ('bags of features' based on key-points or salience measures) from a set of training images. This works well for texture analysis in homogeneous images, but the images that arise in natural object recognition tasks have far less uniform statistics. We show that for dense sampling, k-means over-adapts to this, clustering centres almost exclusively around the densest few regions in descriptor space and thus failing to code other informative regions. This gives suboptimal codes that are no better than using randomly selected centres. We describe a scalable acceptance-radius based clusterer that generates better codebooks and study its performance on several image classification tasks. We also show that dense representations outperform equivalent keypoint based ones on these tasks and that SVM or mutual information based feature selection starting from a dense codebook further improves the performance.
Document type :
Conference papers
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/inria-00548511
Contributor : Thoth Team <>
Submitted on : Monday, December 20, 2010 - 9:08:15 AM
Last modification on : Tuesday, June 5, 2018 - 6:00:02 PM
Long-term archiving on : Monday, March 21, 2011 - 3:06:24 AM

File

05-jurie-triggs-iccv.pdf
Files produced by the author(s)

Identifiers

Collections

IMAG | INRIA | UGA

Citation

Frédéric Jurie, Bill Triggs. Creating Efficient Codebooks for Visual Recognition. 10th International Conference on Computer Vision (ICCV '05), Oct 2005, Beijing, China. pp.604 -- 610, ⟨10.1109/ICCV.2005.66⟩. ⟨inria-00548511⟩

Share

Metrics

Record views

535

Files downloads

1035