Skip to Main content Skip to Navigation
Conference papers

NetVLAD: CNN architecture for weakly supervised place recognition

Abstract : We tackle the problem of large scale visual place recognition , where the task is to quickly and accurately recognize the location of a given query photograph. We present the following three principal contributions. First, we develop a convolutional neural network (CNN) architecture that is trainable in an end-to-end manner directly for the place recognition task. The main component of this architecture, NetVLAD, is a new generalized VLAD layer, inspired by the " Vector of Locally Aggregated Descriptors " image representation commonly used in image retrieval. The layer is readily pluggable into any CNN architecture and amenable to training via backpropagation. Second, we develop a training procedure, based on a new weakly supervised ranking loss, to learn parameters of the architecture in an end-to-end manner from images depicting the same places over time downloaded from Google Street View Time Machine. Finally, we show that the proposed architecture obtains a large improvement in performance over non-learnt image representations as well as significantly outperforms off-the-shelf CNN descriptors on two challenging place recognition benchmarks, and outperforms current state-of-the-art compact image representations on standard image retrieval benchmarks.
Document type :
Conference papers
Complete list of metadata

Cited literature [88 references]  Display  Hide  Download

https://hal.inria.fr/hal-01242052
Contributor : Relja Arandjelović Connect in order to contact the contributor
Submitted on : Monday, May 23, 2016 - 5:38:16 PM
Last modification on : Friday, January 21, 2022 - 3:19:43 AM

File

cvpr16_place.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01242052, version 3
  • ARXIV : 1511.07247

Collections

Citation

Relja Arandjelovic, Petr Gronat, Akihiko Torii, Tomas Pajdla, Josef Sivic. NetVLAD: CNN architecture for weakly supervised place recognition. CVPR 2016 - 29th IEEE Conference on Computer Vision and Pattern Recognition, Jun 2016, Las Vegas, United States. ⟨hal-01242052v3⟩

Share

Metrics

Les métriques sont temporairement indisponibles