Skip to Main content Skip to Navigation
New interface
Journal articles

Visual query expansion with or without geometry: refining local descriptors by feature aggregation

Giorgos Tolias 1 Hervé Jégou 1 
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper proposes a query expansion technique for image search that is faster and more precise than the existing ones. An enriched representation of the query is obtained by exploiting the binary representation offered by the Hamming Embedding image matching approach: The initial local descriptors are refined by aggregating those of the database, while new descriptors are produced from the images that are deemed relevant. The technique has two computational advantages over other query expansion techniques. First, the size of the enriched representation is comparable to that of the initial query. Second, the technique is effective even without using any geometry, in which case searching a database comprising 105k images typically takes 80 ms on a desktop machine. Overall, our technique significantly outperforms the visual query expansion state of the art on popular benchmarks. It is also the first query expansion technique shown effective on the UKB benchmark, which has few relevant images per query.
Document type :
Journal articles
Complete list of metadata

Cited literature [38 references]  Display  Hide  Download
Contributor : Hervé Jégou Connect in order to contact the contributor
Submitted on : Wednesday, April 2, 2014 - 4:01:40 PM
Last modification on : Thursday, January 20, 2022 - 4:18:26 PM
Long-term archiving on: : Wednesday, July 2, 2014 - 12:21:27 PM


Files produced by the author(s)


  • HAL Id : hal-00971267, version 1


Giorgos Tolias, Hervé Jégou. Visual query expansion with or without geometry: refining local descriptors by feature aggregation. Pattern Recognition, 2014. ⟨hal-00971267⟩



Record views


Files downloads