Visual query expansion with or without geometry: refining local descriptors by feature aggregation

Giorgos Tolias 1 Hervé Jégou 1
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper proposes a query expansion technique for image search that is faster and more precise than the existing ones. An enriched representation of the query is obtained by exploiting the binary representation offered by the Hamming Embedding image matching approach: The initial local descriptors are refined by aggregating those of the database, while new descriptors are produced from the images that are deemed relevant. The technique has two computational advantages over other query expansion techniques. First, the size of the enriched representation is comparable to that of the initial query. Second, the technique is effective even without using any geometry, in which case searching a database comprising 105k images typically takes 80 ms on a desktop machine. Overall, our technique significantly outperforms the visual query expansion state of the art on popular benchmarks. It is also the first query expansion technique shown effective on the UKB benchmark, which has few relevant images per query.
Document type :
Journal articles
Complete list of metadatas

Cited literature [38 references]  Display  Hide  Download


https://hal.inria.fr/hal-00971267
Contributor : Hervé Jégou <>
Submitted on : Wednesday, April 2, 2014 - 4:01:40 PM
Last modification on : Friday, November 16, 2018 - 1:23:23 AM
Long-term archiving on : Wednesday, July 2, 2014 - 12:21:27 PM

Files

tolias_lqe14.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00971267, version 1

Citation

Giorgos Tolias, Hervé Jégou. Visual query expansion with or without geometry: refining local descriptors by feature aggregation. Pattern Recognition, Elsevier, 2014. ⟨hal-00971267⟩

Share

Metrics

Record views

811

Files downloads

2230