Accurate real-time tracking using mutual information

Amaury Dame 1 E. Marchand 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper we present a direct tracking approach that uses Mutual Information (MI) as a metric for alignment. The proposed approach is robust, real-time and gives an accurate estimation of the displace- ment that makes it adapted to augmented reality applications. MI is a measure of the quantity of information shared by signals that has been widely used in medical applications. Since then, and although MI has the ability to perform robust alignment with illumination changes, multi-modality and partial occlusions, few works propose MI-based applications related to object tracking in image sequences due to some optimization problems. In this work, we propose an optimization method that is adapted to the MI cost function and gives a practical solution for augmented reality application. We show that by refining the computation of the Hessian matrix and using a specific optimization approach, the tracking results are far more robust and accurate than the existing solutions. A new approach is also proposed to speed up the compu- tation of the derivatives and keep the same optimization efficiency. To validate the advantages of the proposed approach, several ex- periments are performed. The ESM and the proposed MI tracking approaches are compared on a standard dataset. We also show the robustness of the proposed approach on registration applications with different sensor modalities: map versus satellite images and satellite images versus airborne infrared images within different AR applications.
Keywords : tracking
Type de document :
Communication dans un congrès
IEEE Int. Symp. on Mixed and Augmented Reality, ISMAR'10, 2010, Seoul, Korea, South Korea. pp.47-56, 2010
Liste complète des métadonnées

Littérature citée [22 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00544786
Contributeur : Eric Marchand <>
Soumis le : jeudi 9 décembre 2010 - 00:15:58
Dernière modification le : mercredi 16 mai 2018 - 11:23:03
Document(s) archivé(s) le : jeudi 10 mars 2011 - 11:37:51

Fichier

2010_ismar_dame.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00544786, version 1

Citation

Amaury Dame, E. Marchand. Accurate real-time tracking using mutual information. IEEE Int. Symp. on Mixed and Augmented Reality, ISMAR'10, 2010, Seoul, Korea, South Korea. pp.47-56, 2010. 〈inria-00544786〉

Partager

Métriques

Consultations de la notice

463

Téléchargements de fichiers

326