A Bio-inspired Synergistic Virtual Retina Model for Tone Mapping

Abstract : Real-world radiance values span several orders of magnitudes which have to be processed by artificial systems in order to capture visual scenes with a high visual sensitivity. Interestingly, it has been found that similar processing happen in biological systems, starting at the retina level. So our motivation in this paper is to develop a new video tone mapping operator (TMO) based on a synergistic model of the retina. We start from the so-called Virtual Retina model, which has been developed in computational neuroscience. We show how to enrich this model with new features to use it as a TMO, such as color management, luminance adaptation at photoreceptor level and readout from a heterogeneous population activity. Our method works for video but can also be applied to static image (by repeating image in time). It has been carefully evaluated on standard benchmarks in the static case, giving comparable results to the state-of-the- art using default parameters, while offering user control for finer tuning. Result on HDR video are also promising, specifically w.r.t. temporal luminance coherency. Code is available as a Python notebook and a C++ implementation through GitHub so that reader could test and experiment the approach step-by-step. As a whole, this paper shows a promising way to address computational photography challenges by exploiting the current research in neuroscience about retina processing.
Complete list of metadatas

https://hal.inria.fr/hal-01478391
Contributor : Pierre Kornprobst <>
Submitted on : Wednesday, November 22, 2017 - 2:39:57 PM
Last modification on : Friday, December 14, 2018 - 2:32:25 PM

File

RR-9033-v3-2.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01478391, version 2

Collections

Citation

Marco Benzi, Maria-Jose Escobar, Pierre Kornprobst. A Bio-inspired Synergistic Virtual Retina Model for Tone Mapping . [Research Report] RR-9033, Inria Sophia Antipolis. 2017, pp.30. ⟨hal-01478391v2⟩

Share

Metrics

Record views

519

Files downloads

145