Skip to Main content Skip to Navigation
Conference papers

Unifying discriminative visual codebook generation with classifier training for object category recognition

Liu Yang 1 Rong Jin 1 Rahul Sukthankar 2, 3 Frédéric Jurie 4
4 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : The idea of representing images using a bag of visual words is currently popular in object category recognition. Since this representation is typically constructed using unsupervised clustering, the resulting visual words may not capture the desired information. Recent work has explored the construction of discriminative visual codebooks that explicitly consider object category information. However, since the codebook generation process is still disconnected from that of classifier training, the set of resulting visual words, while individually discriminative, may not be those best suited for the classifier. This paper proposes a novel optimization framework that unifies codebook generation with classifier training. In our approach, each image feature is encoded by a sequence of ldquovisual bitsrdquo optimized for each category. An image, which can contain objects from multiple categories, is represented using aggregates of visual bits for each category. Classifiers associated with different categories determine how well a given image corresponds to each category. Based on the performance of these classifiers on the training data, we augment the visual words by generating additional bits. The classifiers are then updated to incorporate the new representation. These two phases are repeated until the desired performance is achieved. Experiments compare our approach to standard clustering-based methods and with state-of-the-art discriminative visual codebook generation. The significant improvements over previous techniques clearly demonstrate the value of unifying representation and classification into a single optimization framework.
Document type :
Conference papers
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download
Contributor : Thoth Team Connect in order to contact the contributor
Submitted on : Thursday, January 6, 2011 - 11:42:38 AM
Last modification on : Tuesday, October 19, 2021 - 11:13:03 PM
Long-term archiving on: : Monday, November 5, 2012 - 3:45:33 PM


Files produced by the author(s)




Liu Yang, Rong Jin, Rahul Sukthankar, Frédéric Jurie. Unifying discriminative visual codebook generation with classifier training for object category recognition. CVPR '08 - Conference on Computer Vision & Pattern Recognition, Jun 2008, Anchorage, United States. pp.1-8, ⟨10.1109/CVPR.2008.4587504⟩. ⟨inria-00548653⟩



Les métriques sont temporairement indisponibles