Abstract:Abstract The stochastic nature of Monte Carlo rendering algorithms inherently produces noisy images. Essentially, three approaches have been developed to solve this issue: improving the ray‐tracing strategies to reduce pixel variance, providing adaptive sampling by increasing the number of rays in regions needing so, and filtering the noisy image as a post‐process. Although the algorithms from the latter category introduce bias, they remain highly attractive as they quickly improve the visual quality of the images, are compatible with all sorts of rendering effects, have a low computational cost and, for some of them, avoid deep modifications of the rendering engine. In this paper, we build upon recent advances in both non‐local and collaborative filtering methods to propose a new efficient denoising operator for Monte Carlo rendering. Starting from the local statistics which emanate from the pixels sample distribution, we enrich the image with local covariance measures and introduce a nonlocal bayesian filter which is specifically designed to address the noise stemming from Monte Carlo rendering. The resulting algorithm only requires the rendering engine to provide for each pixel a histogram and a covariance matrix of its color samples. Compared to state‐of‐the‐art sample‐based methods, we obtain improved denoising results, especially in dark areas, with a large increase in speed and more robustness with respect to the main parameter of the algorithm. We provide a detailed mathematical exposition of our bayesian approach, discuss extensions to multiscale execution, adaptive sampling and animated scenes, and experimentally validate it on a collection of scenes.

Adversarial Monte Carlo denoising with conditioned auxiliary feature modulation

Image denoising algorithm based on adversarial learning using joint loss function

DMCR-GAN: Adversarial Denoising for Monte Carlo Renderings with Residual Attention Networks and Hierarchical Features Modulation of Auxiliary Buffers

Denoising Adversarial Networks for Rain Removal and Reflection Removal.

A Multi-Scale Generative Adversarial Network for Real-World Image Denoising

Bayesian Collaborative Denoising for Monte Carlo Rendering

Denoising Monte Carlo renderings via a multi-scale featured dual-residual GAN

Ensemble Denoising for Monte Carlo Renderings.

A detail preserving neural network model for Monte Carlo denoising

Denoising Deep Monte Carlo Renderings

Real-time Monte Carlo Denoising with Weight Sharing Kernel Prediction Network

Monte Carlo Denoising Via Multi-scale Auxiliary Feature Fusion Guided Transformer.

Deep residual learning for denoising Monte Carlo renderings

A survey on deep learning-based Monte Carlo denoising

Progressive Denoising of Monte Carlo Rendered Images

Denoising Monte Carlo Renders with Diffusion Models

Monte Carlo Denoising with a Sparse Auxiliary Feature Encoder

Real-Time Monte Carlo Denoising With Adaptive Fusion Network

Two-Stage Monte Carlo Denoising with Adaptive Sampling and Kernel Pool

Pixel-wise Guidance for Utilizing Auxiliary Features in Monte Carlo Denoising

Path‐based Monte Carlo Denoising Using a Three‐Scale Neural Network