Skip to Main content Skip to Navigation
Conference papers

Tracking-by-Synthesis Using Point Features and Pyramidal Blurring

Gilles Simon 1 
1 MAGRIT - Visual Augmentation of Complex Environments
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Tracking-by-synthesis is a promising method for markerless vision-based camera tracking, particularly suitable for Augmented Reality applications. In particular, it is drift-free, viewpoint invariant and easy-to-combine with physical sensors such as GPS and inertial sensors. While edge features have been used succesfully within the tracking-by-synthesis framework, point features have, to our knowledge, still never been used. We believe that this is due to the fact that real-time corner detectors are generally weakly repeatable between a camera image and a rendered texture. In this paper, we compare the repeatability of commonly used FAST, Harris and SURF interest point detectors across view synthesis. We show that adding depth blur to the rendered texture can drastically improve the repeatability of FAST and Harris corner detectors (up to 100% in our experiments), which can be very helpful, e.g., to make tracking-by-synthesis running on mobile phones. We propose a method for simulating depth blur on the rendered images using a pre-calibrated depth response curve. In order to fulfil the performance requirements, a pyramidal approach is used based on the well-known MIP mapping technique. We also propose an original method for calibrating the depth response curve, which is suitable for any kind of focus lenses and comes for free in terms of programming effort, once the tracking-by-synthesis algorithm has been implemented.
Document type :
Conference papers
Complete list of metadata

Cited literature [29 references]  Display  Hide  Download
Contributor : Gilles Simon Connect in order to contact the contributor
Submitted on : Tuesday, January 3, 2012 - 3:36:17 PM
Last modification on : Thursday, January 20, 2022 - 5:33:05 PM
Long-term archiving on: : Monday, November 19, 2012 - 12:03:06 PM


Files produced by the author(s)


  • HAL Id : inria-00614867, version 1



Gilles Simon. Tracking-by-Synthesis Using Point Features and Pyramidal Blurring. 10th IEEE International Symposium on Mixed and Augmented Reality - ISMAR 2011, Oct 2011, Basel, Switzerland. ⟨inria-00614867⟩



Record views


Files downloads