Aggregating local image descriptors into compact codes

Hervé Jégou 1 Florent Perronnin 2 Matthijs Douze 3, 4 Jorge Sánchez 2 Patrick Pérez 5 Cordelia Schmid 3
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
2 Xerox Research Centre Europe [Meylan]
3 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
4 SED [Grenoble]
5 Technicolor R & I [Cesson Sévigné]
Abstract : This paper addresses the problem of large-scale image search. Three constraints have to be taken into account: search accuracy, efficiency, and memory usage. We first present and evaluate different ways of aggregating local image descriptors into a vector and show that the Fisher kernel achieves better performance than the reference bag-of-visual words approach for any given vector dimension. We then jointly optimize dimensionality reduction and indexing in order to obtain a precise vector comparison as well as a compact representation. The evaluation shows that the image representation can be reduced to a few dozen bytes while preserving high accuracy. Searching a 100 million image dataset takes about 250 ms on one processor core.
Keywords : image search image retrieval indexing
Document type :
Journal articles
Complete list of metadatas

Cited literature [38 references]  Display  Hide  Download

teaser.jpg
teaser.jpg
https://hal.inria.fr/inria-00633013
Contributor : Hervé Jégou <>
Submitted on : Monday, October 17, 2011 - 2:18:08 PM
Last modification on : Tuesday, June 18, 2019 - 3:38:04 PM
Long-term archiving on: Thursday, November 15, 2012 - 9:50:17 AM

Files

jegou_aggregate.pdf
Files produced by the author(s)

Identifiers

Collections

CNRS | INRIA | UNIV-RENNES1 | IRISA | LJK | LJK_GI_LEAR | LJK_GI | UGA | IRISA-D6 | UR1-UFR-ISTIC | UNIV-RENNES | INSA-GROUPE

Citation

Hervé Jégou, Florent Perronnin, Matthijs Douze, Jorge Sánchez, Patrick Pérez, et al.. Aggregating local image descriptors into compact codes. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2012, 34 (9), pp.1704-1716. ⟨10.1109/TPAMI.2011.235⟩. ⟨inria-00633013⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

5662

Files downloads

19571

 

 

Contact

archive-ouverte@inria.fr