Efficient Subframe Video Alignment Using Short Descriptors

Georgios Evangelidis 1 Christian Bauckhage 2
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper addresses the problem of video alignment. We present efficient approaches that allow for spatiotemporal alignment of two sequences. Unlike most related works, we consider independently moving cameras that capture a 3D scene at different times. The novelty of the proposed method lies in the adaptation and extension of an efficient information retrieval framework that casts the sequences as an image database and a set of query frames, respectively. The efficient retrieval builds on the recently proposed quad descriptor. In this context, we define the 3D Vote Space (VS) by aggregating votes through a multiquerying (multiscale) scheme and we present two solutions based on VS entries; a causal solution that permits online synchronization and a global solution through multiscale dynamic programming. In addition, we extend the recently introduced ECC image-alignment algorithm to the temporal dimension that allows for spatial registration and synchronization refinement with subframe accuracy. We investigate full search and quantization methods for short descriptors and we compare the proposed schemes with the state of the art. Experiments with real videos by moving or static cameras demonstrate the efficiency of the proposed method and verify its effectiveness with respect to spatiotemporal alignment accuracy.
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (10), pp.2371-2386. 〈http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6482136〉. 〈10.1109/TPAMI.2013.56〉
Liste complète des métadonnées

Littérature citée [37 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-00862002
Contributeur : Team Perception <>
Soumis le : mardi 24 septembre 2013 - 15:10:47
Dernière modification le : jeudi 11 janvier 2018 - 06:22:00
Document(s) archivé(s) le : vendredi 7 avril 2017 - 00:56:30

Fichiers

PAMI_2013.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Georgios Evangelidis, Christian Bauckhage. Efficient Subframe Video Alignment Using Short Descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (10), pp.2371-2386. 〈http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6482136〉. 〈10.1109/TPAMI.2013.56〉. 〈hal-00862002v2〉

Partager

Métriques

Consultations de la notice

751

Téléchargements de fichiers

572