Tracking-by-Synthesis Using Point Features and Pyramidal Blurring

Gilles Simon 1
1 MAGRIT - Visual Augmentation of Complex Environments
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Tracking-by-synthesis is a promising method for markerless vision-based camera tracking, particularly suitable for Augmented Reality applications. In particular, it is drift-free, viewpoint invariant and easy-to-combine with physical sensors such as GPS and inertial sensors. While edge features have been used succesfully within the tracking-by-synthesis framework, point features have, to our knowledge, still never been used. We believe that this is due to the fact that real-time corner detectors are generally weakly repeatable between a camera image and a rendered texture. In this paper, we compare the repeatability of commonly used FAST, Harris and SURF interest point detectors across view synthesis. We show that adding depth blur to the rendered texture can drastically improve the repeatability of FAST and Harris corner detectors (up to 100% in our experiments), which can be very helpful, e.g., to make tracking-by-synthesis running on mobile phones. We propose a method for simulating depth blur on the rendered images using a pre-calibrated depth response curve. In order to fulfil the performance requirements, a pyramidal approach is used based on the well-known MIP mapping technique. We also propose an original method for calibrating the depth response curve, which is suitable for any kind of focus lenses and comes for free in terms of programming effort, once the tracking-by-synthesis algorithm has been implemented.
Type de document :
Communication dans un congrès
10th IEEE International Symposium on Mixed and Augmented Reality - ISMAR 2011, Oct 2011, Basel, Switzerland. 2011
Liste complète des métadonnées

Littérature citée [29 références]  Voir  Masquer  Télécharger
Contributeur : Gilles Simon <>
Soumis le : mardi 3 janvier 2012 - 15:36:17
Dernière modification le : jeudi 11 janvier 2018 - 06:20:14
Document(s) archivé(s) le : lundi 19 novembre 2012 - 12:03:06


Fichiers produits par l'(les) auteur(s)


  • HAL Id : inria-00614867, version 1



Gilles Simon. Tracking-by-Synthesis Using Point Features and Pyramidal Blurring. 10th IEEE International Symposium on Mixed and Augmented Reality - ISMAR 2011, Oct 2011, Basel, Switzerland. 2011. 〈inria-00614867〉



Consultations de la notice


Téléchargements de fichiers