Skip to Main content Skip to Navigation
New interface
Conference papers

Multimodal image alignment through a multiscale chain of neural networks with application to remote sensing

Armand Zampieri 1 Guillaume Charpiat 2 Nicolas Girard 1 Yuliya Tarabalka 1 
1 TITANE - Geometric Modeling of 3D Environments
CRISAM - Inria Sophia Antipolis - Méditerranée
2 TAU - TAckling the Underspecified
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
Abstract : We tackle here the problem of multimodal image non-rigid registration, which is of prime importance in remote sensing and medical imaging. The difficulties encountered by classical registration approaches include feature design and slow optimization by gradient descent. By analyzing these methods, we note the significance of the notion of scale. We design easy-to-train, fully-convolutional neural networks able to learn scale-specific features. Once chained appropriately, they perform global registration in linear time, getting rid of gradient descent schemes by predicting directly the deformation. We show their performance in terms of quality and speed through various tasks of remote sensing multimodal image alignment. In particular, we are able to register correctly cadastral maps of buildings as well as road polylines onto RGB images, and outperform current keypoint matching methods.
Document type :
Conference papers
Complete list of metadata

Cited literature [44 references]  Display  Hide  Download
Contributor : Yuliya Tarabalka Connect in order to contact the contributor
Submitted on : Thursday, July 26, 2018 - 10:30:23 AM
Last modification on : Tuesday, October 25, 2022 - 4:16:50 PM
Long-term archiving on: : Saturday, October 27, 2018 - 12:31:56 PM


Files produced by the author(s)


  • HAL Id : hal-01849389, version 1



Armand Zampieri, Guillaume Charpiat, Nicolas Girard, Yuliya Tarabalka. Multimodal image alignment through a multiscale chain of neural networks with application to remote sensing. European Conference on Computer Vision (ECCV), Sep 2018, Munich, Germany. pp.679-696. ⟨hal-01849389⟩



Record views


Files downloads