Skip to Main content Skip to Navigation
Reports

Robust and real-time image-based tracking for markerless augmented reality

Andrew Comport 1 Eric Marchand 1 François Chaumette 1
1 VISTA - Vision spatio-temporelle et active
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : Augmented Reality has now progressed to the point where real-time applications are being considered and needed. At the same time it is important that synthetic elements are rendered and aligned in the scene in an accurate and visually acceptable way. In order to address these issues a real-time, robust and efficient 3D model-based tracking algorithm is proposed for a 'video see through' monocular vision system. The tracking of objects in the scene amounts to calculating the pose between the camera and the objects. Virtual objects can then be projected into the scene using the pose. Here, non-linear pose computation is formulated by means of a virtual visual servoing approach. In this context, the derivation of point-to-curves interaction matrices are given for different features including lines, circles, cylinders and spheres. A local moving edges tracker is used in order to provide real-time tracking of points normal to the object contours. A method is proposed for combining local position uncertainty and global pose uncertainty in an efficient and accurate way by propagating uncertainty. Robustness is obtained by integrating a M-estimator into the visual control law via an iteratively re-weighted least squares implementation. The method presented in this paper has been validated on several complex image sequences including outdoor environments. Results show the method to be robust to occlusion, changes in illumination and miss-tracking.
Document type :
Reports
Complete list of metadata

Cited literature [31 references]  Display  Hide  Download

https://hal.inria.fr/inria-00071736
Contributor : Rapport de Recherche Inria <>
Submitted on : Tuesday, May 23, 2006 - 6:38:35 PM
Last modification on : Thursday, January 7, 2021 - 4:28:22 PM
Long-term archiving on: : Sunday, April 4, 2010 - 10:35:46 PM

Identifiers

  • HAL Id : inria-00071736, version 1

Citation

Andrew Comport, Eric Marchand, François Chaumette. Robust and real-time image-based tracking for markerless augmented reality. [Research Report] RR-4847, INRIA. 2003. ⟨inria-00071736⟩

Share

Metrics

Record views

488

Files downloads

293