Multi-Mask Camera Model for Compressed Acquisition of Light Fields - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Computational Imaging Année : 2021

Multi-Mask Camera Model for Compressed Acquisition of Light Fields

Résumé

We present an all-in-one camera model that encompasses the architectures of most existing compressive-sensing light-field cameras, equipped with a single lens and multiple amplitude coded masks that can be placed at different positions between the lens and the sensor. The proposed model, named the equivalent multi-mask camera (EMMC) model, enables the comparison between different camera designs, e.g using monochrome or CFA-based sensors, single or multiple acquisitions, or varying pixel sizes, via a simple adaptation of the sampling operator. In particular, in the case of a camera equipped with a CFA-based sensor and a coded mask, this model allows us to jointly perform color demosaicing and light field spatioangular reconstruction. In the case of variable pixel size, it allows to perform spatial super-resolution in addition to angularreconstruction. While the EMMC model is generic and can be used with any reconstruction algorithm, we validate the proposed model with a dictionary-based reconstruction algorithm and a regularization-based reconstruction algorithm using a 4D TotalVariation-based regularizer for light field data. Experimental results with different reconstruction algorithms show that the proposed model can flexibly adapt to various sensing schemes. They also show the advantage of using an in-built CFA sensor with respect to monochrome sensors classically used in the literature.
Fichier principal
Vignette du fichier
DevCam_TCI_Final.pdf (34.39 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03104409 , version 1 (08-01-2021)

Identifiants

Citer

Hoai Nam Nguyen, Ehsan Miandji, Christine Guillemot. Multi-Mask Camera Model for Compressed Acquisition of Light Fields. IEEE Transactions on Computational Imaging, 2021, 7, pp.191-208. ⟨10.1109/TCI.2021.3053702⟩. ⟨hal-03104409⟩
83 Consultations
60 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More