Recent advance in image search

Hervé Jégou 1, 2 Matthijs Douze 1 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 VISTAS - Spatio-Temporal Vision and Learning
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper introduces recent methods for large scale image search. State-of-the-art methods build on the bag-of-features image representation. We first analyze bag-of-features in the framework of approximate nearest neighbor search. This shows the sub-optimality of such a representation for matching descriptors and leads us to derive a more precise representation based on 1) Hamming embedding (HE) and 2) weak geometric consistency constraints (WGC). HE provides binary signatures that refine the matching based on visual words. WGC filters matching descriptors that are not consistent in terms of angle and scale. HE and WGC are integrated within an inverted file and are efficiently exploited for all images, even in the case of very large datasets. Experiments performed on a dataset of one million of images show a significant improvement due to the binary signature and the weak geometric consistency constraints, as well as their efficiency. Estimation of the full geometric transformation, i.e., a re-ranking step on a short list of images, is complementary to our weak geometric consistency constraints and allows to further improve the accuracy.
Type de document :
Chapitre d'ouvrage
Frank Nielsen. Emerging Trends in Visual Computing, 5416, Springer-Verlag, pp.305-326, 2009, Lecture Notes in Computer Science, 978-3-642-00826-9. <10.1007/978-3-642-00826-9_14>
Liste complète des métadonnées


wgc.jpg
wgc.jpg
https://hal.inria.fr/inria-00548648
Contributeur : Hervé Jégou <>
Soumis le : lundi 20 décembre 2010 - 10:24:11
Dernière modification le : vendredi 13 janvier 2017 - 14:15:09
Document(s) archivé(s) le : lundi 21 mars 2011 - 03:27:27

Fichiers

ETCV08.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

INRIA | IRISA | UGA | LJK_GI_LEAR | LJK | LJK_GI | UR1-UFR-ISTIC

Citation

Hervé Jégou, Matthijs Douze, Cordelia Schmid. Recent advance in image search. Frank Nielsen. Emerging Trends in Visual Computing, 5416, Springer-Verlag, pp.305-326, 2009, Lecture Notes in Computer Science, 978-3-642-00826-9. <10.1007/978-3-642-00826-9_14>. <inria-00548648>

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de
la notice

499

Téléchargements du document

514

Contact


archive-ouverte@inria.fr