Guided inpainting with cluster-based auxiliary information

Abstract : In this paper, we propose a new guided inpainting algorithm based on the exemplar-based approach in order to effectively fill in holes in image synthesis applications. Guided inpainting techniques can be very useful in settings where one has access to the ground truth information like most multiview coding applications. We propose a new auxiliary information based on patch clustering, which is used to refine the candidate exemplar set in the inpainting. For that purpose, a new recursive clustering method based on locally linear embedding (LLE) is introduced. We then design the guided inpainting solution based on LLE with clustered patches, which contrains the reconstruction to operate in one patch cluster only. The index of the appropriate cluster considered as auxiliary information. Experimental results show that our clustering algorithm provides clusters that are well suited to the inpainting problem. They also show that the auxiliary information enables to significantly improve the quality of the inpainted image for a small coding cost. This work is the first study to show that effective inpainting can be performed when the auxiliary information is properly adapted to the characteristics of both the hole and the known texture.
Type de document :
Communication dans un congrès
IEEE ICIP, Sep 2015, Québec, Canada. 2015
Liste complète des métadonnées

https://hal.inria.fr/hal-01204698
Contributeur : Thomas Maugey <>
Soumis le : jeudi 24 septembre 2015 - 14:26:22
Dernière modification le : mardi 16 janvier 2018 - 15:54:20

Identifiants

  • HAL Id : hal-01204698, version 1

Citation

Thomas Maugey, Pascal Frossard, Christine Guillemot. Guided inpainting with cluster-based auxiliary information. IEEE ICIP, Sep 2015, Québec, Canada. 2015. 〈hal-01204698〉

Partager

Métriques

Consultations de la notice

237