Skip to Main content Skip to Navigation
Conference papers

Robust non-rigid registration through agent-based action learning

Abstract : Robust image registration in medical imaging is essential for comparison or fusion of images, acquired from various perspectives, modalities or at different times. Typically, an objective function needs to be minimized assuming specific a priori deformation models and pre-defined or learned similarity measures. However, these approaches have difficulties to cope with large deformations or a large variability in appearance. Using modern deep learning (DL) methods with automated feature design, these limitations could be resolved by learning the intrinsic mapping solely from experience. We investigate in this paper how DL could help organ-specific (ROI-specific) deformable registration, to solve motion compensation or atlas-based segmentation problems for instance in prostate diagnosis. An artificial agent is trained to solve the task of non-rigid registration by exploring the parametric space of a statistical deformation model built from training data. Since it is difficult to extract trustworthy ground-truth deformation fields, we present a training scheme with a large number of synthetically deformed image pairs requiring only a small number of real inter-subject pairs. Our approach was tested on inter-subject registration of prostate MR data and reached a median DICE score of .88 in 2-D and .76 in 3-D, therefore showing improved results compared to state-of-the-art registration algorithms.
Document type :
Conference papers
Complete list of metadata

Cited literature [10 references]  Display  Hide  Download
Contributor : Project-Team Asclepios <>
Submitted on : Wednesday, July 26, 2017 - 5:25:08 PM
Last modification on : Thursday, February 7, 2019 - 4:47:33 PM


Files produced by the author(s)




Julian Krebs, Tommaso Mansi, Hervé Delingette, Li Zhang, Florin Ghesu, et al.. Robust non-rigid registration through agent-based action learning. Medical Image Computing and Computer Assisted Interventions (MICCAI), Sep 2017, Quebec, Canada. pp.344-352, ⟨10.1007/978-3-319-66182-7_40⟩. ⟨hal-01569447⟩



Record views


Files downloads