Skip to Main content Skip to Navigation
Journal articles

A Detail Preserving Neural Network Model for Monte Carlo Denoising

Weiheng Lin 1 Beibei Wang 1 Lu Wang 2 Nicolas Holzschuch 3
3 MAVERICK - Models and Algorithms for Visualization and Rendering
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : Monte Carlo based methods such as path tracing are widely used in movie production. To achieve noise-free quality, they tend to require a large number of samples per pixel, resulting in longer rendering time. To reduce that cost, one solution is Monte Carlo denoising: render the image with fewer samples per pixel (as little as 128) and then denoise the resulting image. Many Monte Carlo denoising methods rely on deep learning: they use convolutional neural networks to learn the relationship between noisy images and reference images, using auxiliary features such as position and normal together with image color as inputs. The network predicts kernels which are then applied to the noisy input. These methods have shown powerful denoising ability. However, they tend to lose geometric details or lighting details and over blur sharp features during denoising. In this paper, we solve this issue by proposing a novel network structure, a new input feature-light transport covariance from path space-and an improved loss function. In our network, we separate feature buffers with color buffer to enhance detail effects. Their features are extracted separately and then are integrated to a shallow kernel predictor. Our loss function considers perceptual loss, which also improves the detail preserving. In addition, we present the light transport covariance feature in path space as one of the features, which is used to preserve illumination details. Our method denoises Monte Carlo path traced images while preserving details much better than previous work.
Document type :
Journal articles
Complete list of metadata

Cited literature [29 references]  Display  Hide  Download
Contributor : Beibei Wang Connect in order to contact the contributor
Submitted on : Sunday, February 23, 2020 - 3:00:11 AM
Last modification on : Friday, November 5, 2021 - 6:26:08 PM
Long-term archiving on: : Sunday, May 24, 2020 - 12:20:28 PM


Files produced by the author(s)




Weiheng Lin, Beibei Wang, Lu Wang, Nicolas Holzschuch. A Detail Preserving Neural Network Model for Monte Carlo Denoising. Computational Visual Media, Springer, 2020, 6, pp.157-168. ⟨10.1007/s41095-020-0167-7⟩. ⟨hal-02488602⟩



Record views


Files downloads