Skip to Main content Skip to Navigation
Conference papers

Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking

Filip Radenović 1 Ahmet Iscen 1 Giorgos Tolias 1 Yannis Avrithis 2 Ondřej Chum 1
1 VRG - Visual Recognition Group [Prague]
CTU/FEE - Faculty of electrical engineering [Prague]
2 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : In this paper we address issues with image retrieval benchmarking on standard and popular Oxford 5k and Paris 6k datasets. In particular, annotation errors, the size of the dataset, and the level of challenge are addressed: new annotation for both datasets is created with an extra attention to the reliability of the ground truth. Three new protocols of varying difficulty are introduced. The protocols allow fair comparison between different methods, including those using a dataset preprocessing stage. For each dataset, 15 new challenging queries are introduced. Finally, a new set of 1M hard, semi-automatically cleaned distractors is selected. An extensive comparison of the state-of-the-art methods is performed on the new benchmark. Different types of methods are evaluated, ranging from local-feature-based to modern CNN based methods. The best results are achieved by taking the best of the two worlds. Most importantly, image retrieval appears far from being solved.
Complete list of metadatas

Cited literature [95 references]  Display  Hide  Download
Contributor : Yannis Avrithis <>
Submitted on : Wednesday, July 18, 2018 - 2:41:56 PM
Last modification on : Tuesday, February 25, 2020 - 8:08:12 AM
Document(s) archivé(s) le : Friday, October 19, 2018 - 8:13:02 PM


Files produced by the author(s)


  • HAL Id : hal-01843075, version 1
  • ARXIV : 1803.11285


Filip Radenović, Ahmet Iscen, Giorgos Tolias, Yannis Avrithis, Ondřej Chum. Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking. CVPR 2018 - IEEE Computer Vision and Pattern Recognition Conference, Jun 2018, Salt Lake City, United States. pp.1-10. ⟨hal-01843075⟩



Record views


Files downloads