Hamming Embedding and Weak Geometry Consistency for Large Scale Image Search - extended version

Hervé Jégou 1 Matthijs Douze 1 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This technical report presents and extends a recent paper we have proposed for large scale image search. State-of-the-art methods build on the bag-of- features image representation. We first analyze bag-of-features in the framework of approximate nearest neighbor search. This shows the sub-optimality of such a representation for matching descriptors and leads us to derive a more precise representation based on 1) Hamming embedding (HE) and 2) weak geometric consistency constraints (WGC). HE provides binary signatures that refine the matching based on visual words. WGC filters matching descriptors that are not consistent in terms of angle and scale. HE and WGC are integrated within an inverted file and are efficiently exploited for all images, even in the case of very large datasets. Experiments performed on a dataset of one million of images show a significant improvement due to the binary signature and the weak geometric consistency constraints, as well as their efficiency. Estimation of the full geometric transformation, i.e., a re-ranking step on a short list of images, is complementary to our weak geometric consistency constraints and allows to further improve the accuracy.
Liste complète des métadonnées

Cited literature [21 references]  Display  Hide  Download


https://hal.inria.fr/inria-00548651
Contributor : Hervé Jégou <>
Submitted on : Monday, December 20, 2010 - 10:24:17 AM
Last modification on : Monday, December 17, 2018 - 11:22:02 AM
Document(s) archivé(s) le : Monday, November 5, 2012 - 2:42:03 PM

Files

jegou_hewgc_extended.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00548651, version 1

Collections

Citation

Hervé Jégou, Matthijs Douze, Cordelia Schmid. Hamming Embedding and Weak Geometry Consistency for Large Scale Image Search - extended version. [Research Report] 6709, 2008, pp.27. ⟨inria-00548651⟩

Share

Metrics

Record views

4086

Files downloads

939