inria-00602325, version 2
Exploiting descriptor distances for precise image search
Hervé Jégou
a, 1Matthijs Douze
a, 2, 3Cordelia Schmid
a, 2
(2011)
Abstract: This report addresses precise image search based on local descriptors. Our approach extends a k-NN voting scheme in several ways. First, we introduce a query-adaptive criterion that is shown effective to weight the descriptor matches. Second, we exploit the distances between SIFT descriptors and the reciprocal neighbors to further refine the similarity measure between descriptors. Each of these two complementary strategies leads to a significant improvement over the usual voting baseline, and significantly outperforms bag-of-features, at the cost of a high computational and memory complexity due to the exact computation of distances and reciprocal nearest neighbors. In order to make our method tractable, we exploit an approximate search method which, in addition to returning nearest neighbors with high probability, provides precise distance estimates without accessing the full raw vectors, which is critical to avoid memory issues. Experimental results show that our method outperforms the state of the art on four challenging datasets. Although our method is not as efficient as bag-of-features, we show that it can handle a database of up to 1 million images with reasonable query times.
- a – INRIA
- 1: TEXMEX (INRIA - IRISA)
- CNRS : UMR6074 – INRIA – INSA Rennes – Université de Rennes 1
- 2: LEAR (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
- CNRS : FR71 – CNRS : UMR5527 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)
- 3: Service Expérimentation et Développement (SED)
- INRIA
- Domain : Computer Science/Computer Vision and Pattern Recognition
- Keywords : image search – approximate nearest neighbors – image retrieval
- Available versions : v1 (2011-06-22) v2 (2011-06-23)
- inria-00602325, version 2
- http://hal.inria.fr/inria-00602325
- oai:hal.inria.fr:inria-00602325
- From: Hervé Jégou
- Submitted on: Thursday, 23 June 2011 00:03:19
- Updated on: Monday, 27 June 2011 09:20:59







Associated documents
Export