sign in
english version rss feed

inria-00548648, version 1

Recent advance in image search

Hervé Jégou () 123, Matthijs Douze () a12, Cordelia Schmid () 12

Emerging Trends in Visual Computing Springer-Verlag (Ed.) (2009) 305--326

Abstract: This paper introduces recent methods for large scale image search. State-of-the-art methods build on the bag-of-features image representation. We first analyze bag-of-features in the framework of approximate nearest neighbor search. This shows the sub-optimality of such a representation for matching descriptors and leads us to derive a more precise representation based on 1) Hamming embedding (HE) and 2) weak geometric consistency constraints (WGC). HE provides binary signatures that refine the matching based on visual words. WGC filters matching descriptors that are not consistent in terms of angle and scale. HE and WGC are integrated within an inverted file and are efficiently exploited for all images, even in the case of very large datasets. Experiments performed on a dataset of one million of images show a significant improvement due to the binary signature and the weak geometric consistency constraints, as well as their efficiency. Estimation of the full geometric transformation, i.e., a re-ranking step on a short list of images, is complementary to our weak geometric consistency constraints and allows to further improve the accuracy.

  • Icone de wgc.jpg
  • a –  INRIA
  • 1:  LEAR (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
  • CNRS : FR71 – CNRS : UMR5527 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)
  • 2:  Laboratoire Jean Kuntzmann (LJK)
  • CNRS : UMR5224 – Université Joseph Fourier - Grenoble I – Université Pierre Mendès-France - Grenoble II – Institut Polytechnique de Grenoble - Grenoble Institute of Technology
  • 3:  VISTAS (INRIA - IRISA)
  • INRIA – INSA Rennes – CNRS : UMR6074 – Université de Rennes 1 – École normale supérieure de Cachan - ENS Cachan
  • Domain : Computer Science/Computer Vision and Pattern Recognition
 
  • inria-00548648, version 1
  • oai:hal.inria.fr:inria-00548648
  • From: 
  • Submitted for: 
  • Submitted on: Monday, 20 December 2010 10:24:11
  • Updated on: Tuesday, 1 February 2011 09:05:09
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...
all articles on CCSd database...