Local visual query expansion: Exploiting an image collection to refine local descriptors

Giorgos Tolias 1, 2, * Hervé Jégou 2
* Corresponding author
2 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper proposes a query expansion technique for image search that is faster and more precise than the existing ones. An enriched representation of the query is obtained by exploiting the binary representation offered by the Hamming Embedding image matching approach: The initial local descriptors are refined by aggregating those of the database, while new descriptors are produced from the images that are deemed relevant. This approach has two computational advantages over other query expansion techniques. First, the size of the enriched representation is comparable to that of the initial query. Second, the technique is effective even without using any geometry, in which case searching a database comprising 105k images typically takes 79 ms on a desktop machine. Overall, our technique significantly outperforms the visual query expansion state of the art on popular benchmarks. It is also the first query expansion technique shown effective on the UKB benchmark, which has few relevant images per query.
Complete list of metadatas

Cited literature [32 references]  Display  Hide  Download


https://hal.inria.fr/hal-00840721
Contributor : Hervé Jégou <>
Submitted on : Thursday, July 4, 2013 - 3:59:39 PM
Last modification on : Friday, November 16, 2018 - 1:23:38 AM
Long-term archiving on : Wednesday, April 5, 2017 - 6:22:13 AM

Files

RR-8325.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00840721, version 1

Citation

Giorgos Tolias, Hervé Jégou. Local visual query expansion: Exploiting an image collection to refine local descriptors. [Research Report] RR-8325, INRIA. 2013. ⟨hal-00840721⟩

Share

Metrics

Record views

516

Files downloads

1009