Reconstructing an image from its local descriptors

Philippe Weinzaepfel 1 Hervé Jégou 1 Patrick Pérez 2
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper shows that an image can be approximately reconstructed based on the output of a blackbox local description software such as those classically used for image indexing. Our approach consists first in using an off-the-shelf image database to find patches which are visually similar to each region of interest of the unknown input image, according to associated local descriptors. These patches are then warped into input image domain according to interest region geometry and seamlessly stitched together. Final completion of still missing texture-free regions is obtained by smooth interpolation. As demonstrated in our experiments, visually meaningful reconstructions are obtained just based on image local descriptors like SIFT, provided the geometry of regions of interest is known. The reconstruction allows most often the clear interpretation of the semantic image content. As a result, this work raises critical issues of privacy and rights when local descriptors of photos or videos are given away for indexing and search purpose.
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download


https://hal.inria.fr/inria-00566718
Contributor : Hervé Jégou <>
Submitted on : Friday, February 18, 2011 - 4:40:00 PM
Last modification on : Friday, November 16, 2018 - 1:22:54 AM
Long-term archiving on : Saturday, December 3, 2016 - 3:02:22 PM

Files

weinzaepfel_cvpr11.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00566718, version 2

Citation

Philippe Weinzaepfel, Hervé Jégou, Patrick Pérez. Reconstructing an image from its local descriptors. Computer Vision and Pattern Recognition, IEEE, Jun 2011, Colorado Springs, United States. ⟨inria-00566718v2⟩

Share

Metrics

Record views

1582

Files downloads

7011