Second order optimization of mutual information for real-time image registration

Amaury Dame 1 Eric Marchand 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper we present a direct image registration approach that uses Mutual Information (MI) as a metric for alignment. The proposed approach is robust, real-time and gives an accurate estimation of a set of 2D motion parameters. MI is a measure of the quantity of information shared by signals. Although it has the ability to perform robust alignment with illumination changes, multi-modality and partial occlusions, few works propose MI-based applications related to spatio-temporal image registration or object tracking in image sequences due to some optimization problems that we will explain. In this work, we propose a new optimization method that is adapted to the MI cost function and gives a practical solution for real time tracking. We show that by refining the computation of the Hessian matrix and using a specific optimization approach, the registration results are far more robust and accurate than the existing solutions while the computation is cheaper. A new approach is also proposed to speed up the computation of the derivatives and keep an equivalent optimization efficiency. To validate the advantages of the proposed approach, several experiments are performed.
Liste complète des métadonnées

Littérature citée [39 références]  Voir  Masquer  Télécharger
Contributeur : Eric Marchand <>
Soumis le : lundi 12 novembre 2012 - 11:39:43
Dernière modification le : vendredi 16 novembre 2018 - 01:39:38
Document(s) archivé(s) le : samedi 17 décembre 2016 - 09:33:38


Fichiers produits par l'(les) auteur(s)



Amaury Dame, Eric Marchand. Second order optimization of mutual information for real-time image registration. IEEE Trans on Image Processing, IEEE, 2012, 21 (9), pp.4190-4203. 〈10.1109/TIP.2012.2199124〉. 〈hal-00750528〉



Consultations de la notice


Téléchargements de fichiers