Video inpainting with short-term windows: application to object removal and error concealment

Mounira Ebdelli 1 Olivier Le Meur 1 Christine Guillemot 1
1 Sirocco - Analysis representation, compression and communication of visual data
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper, we propose a new video inpainting method which applies to both static or free-moving camera videos. The method can be used for object removal, error concealment and background reconstruction applications. To limit the computational time, a frame is inpainted by considering a small number of neighboring pictures which are grouped into a group of pictures (GoP). More specifically, to inpaint a frame, the method starts by aligning all the frames of the GoP. This is achieved by a region-based homography computation method which allows us to strengthen the spatial consistency of aligned frames. Then, from the stack of aligned frames, an energy function based on both spatial and temporal coherency terms is globally minimized. This energy function is efficient enough to provide high quality results even when the number of pictures in the GoP is rather small, e.g. 20 neighboring frames. This drastically reduces the algorithm complexity and makes the approach well suited for near real-time video editing applications as well as for loss concealment applications. Experiments with several challenging video sequences show that the proposed method provides visually pleasing results for object removal, error concealment and background reconstruction context.
Type de document :
Article dans une revue
IEEE Transaction on Image Processing, IEEE, 2015, 24 (10), pp.3034-47. 〈10.1109/TIP.2015.2437193〉
Liste complète des métadonnées

Littérature citée [50 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01204677
Contributeur : Olivier Le Meur <>
Soumis le : mercredi 30 septembre 2015 - 09:56:23
Dernière modification le : vendredi 16 novembre 2018 - 01:40:19
Document(s) archivé(s) le : jeudi 31 décembre 2015 - 10:12:56

Fichier

Ebdelli_videoInpainting_TIP201...
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Mounira Ebdelli, Olivier Le Meur, Christine Guillemot. Video inpainting with short-term windows: application to object removal and error concealment. IEEE Transaction on Image Processing, IEEE, 2015, 24 (10), pp.3034-47. 〈10.1109/TIP.2015.2437193〉. 〈hal-01204677〉

Partager

Métriques

Consultations de la notice

480

Téléchargements de fichiers

1295