Skip to Main content Skip to Navigation
Journal articles

Second order optimization of mutual information for real-time image registration

Amaury Dame 1 Eric Marchand 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper we present a direct image registration approach that uses Mutual Information (MI) as a metric for alignment. The proposed approach is robust, real-time and gives an accurate estimation of a set of 2D motion parameters. MI is a measure of the quantity of information shared by signals. Although it has the ability to perform robust alignment with illumination changes, multi-modality and partial occlusions, few works propose MI-based applications related to spatio-temporal image registration or object tracking in image sequences due to some optimization problems that we will explain. In this work, we propose a new optimization method that is adapted to the MI cost function and gives a practical solution for real time tracking. We show that by refining the computation of the Hessian matrix and using a specific optimization approach, the registration results are far more robust and accurate than the existing solutions while the computation is cheaper. A new approach is also proposed to speed up the computation of the derivatives and keep an equivalent optimization efficiency. To validate the advantages of the proposed approach, several experiments are performed.
Complete list of metadatas

Cited literature [39 references]  Display  Hide  Download

https://hal.inria.fr/hal-00750528
Contributor : Eric Marchand <>
Submitted on : Monday, November 12, 2012 - 11:39:43 AM
Last modification on : Friday, March 6, 2020 - 1:24:06 AM
Document(s) archivé(s) le : Saturday, December 17, 2016 - 9:33:38 AM

File

TIP-07741-2011-R1-two-columns....
Files produced by the author(s)

Identifiers

Citation

Amaury Dame, Eric Marchand. Second order optimization of mutual information for real-time image registration. IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2012, 21 (9), pp.4190-4203. ⟨10.1109/TIP.2012.2199124⟩. ⟨hal-00750528⟩

Share

Metrics

Record views

816

Files downloads

758