HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

Guiding multimodal registration with learned optimization updates

Abstract : In this paper, we address the multimodal registration problem from a novel perspective, aiming to predict the transformation aligning images directly from their visual appearance. We formulate the prediction as a supervised regression task, with joint image descriptors as input and the output are the parameters of the transformation that guide the moving image towards alignment. We model the joint local appearance with context aware descriptors that capture both local and global cues simultaneously in the two modalities, while the regression function is based on the gradient boosted trees method capable of handling the very large contextual feature space. The good properties of our predictions allow us to couple them with a simple gradient-based optimization for the final registration. Our approach can be applied to any transformation parametrization as well as a broad range of modality pairs. Our method learns the relationship between the intensity distributions of a pair of modalities by using prior knowledge in the form of a small training set of aligned image pairs (in the order of 1-5 in our experiments). We demonstrate the flexibility and generality of our method by evaluating its performance on a variety of multimodal imaging pairs obtained from two publicly available datasets, RIRE (brain MR, CT and PET) and IXI (brain MR). We also show results for the very challenging deformable registration of Intravascular Ultrasound and Histology images. In these experiments, our approach has a larger capture range when compared to other state-of-the-art methods, while improving registration accuracy in complex cases.
Complete list of metadata

Contributor : Diana Mateus Connect in order to contact the contributor
Submitted on : Monday, January 29, 2018 - 11:20:38 PM
Last modification on : Thursday, March 10, 2022 - 6:30:04 PM



Benjamín Gutiérrez-Becker, Diana Mateus, Loic Peter, Nassir Navab. Guiding multimodal registration with learned optimization updates. Medical Image Analysis, Elsevier, 2017, 41, pp.2 - 17. ⟨10.1016/j.media.2017.05.002⟩. ⟨hal-01695990⟩



Record views