Deep Convolutional Matching

Jerome Revaud 1, * Philippe Weinzaepfel 1 Zaid Harchaoui 1 Cordelia Schmid 1
* Corresponding author
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We propose a new matching algorithm, called DeepMatching, to compute dense correspondences between images. DeepMatching relies on a deep, multi-layer, convolutional architecture designed for matching images. The proposed matching algorithm can handle non-rigid deformations and repetitive textures, and can therefore efficiently determine dense correspondences in the presence of significant changes between images. We evaluate the performance of DeepMatching, in comparison with state-of-the-art matching algorithms, on resp. the Mikolajczyk, the MPI-Sintel and the Kitti datasets. The performance measure is "Accuracy@T" , that is the percentage of correct pixels for a specified error threshold of T pixels. Deep-Matching outperforms the state-of-the-art algorithms in terms of accuracy@T and shows excellent results in particular for repetitive textures. We also propose a method for estimating optical flow, called DeepFlow, by integrating a DeepMatching term in a variational energy minimization approach. Robustness to large displacements is obtained due to this matching term. DeepFlow obtains competitive performance on public benchmarks for optical flow estimation. In particular, DeepFlow obtains state-of-the-art results on the MPI-Sintel dataset.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas
Contributor : Thoth Team <>
Submitted on : Thursday, June 4, 2015 - 12:04:46 PM
Last modification on : Monday, December 17, 2018 - 11:22:02 AM
Long-term archiving on : Wednesday, April 19, 2017 - 2:58:43 PM


Files produced by the author(s)


  • HAL Id : hal-01148432, version 1
  • ARXIV : 1506.07656


Jerome Revaud, Philippe Weinzaepfel, Zaid Harchaoui, Cordelia Schmid. Deep Convolutional Matching. 2015. ⟨hal-01148432v1⟩



Record views


Files downloads