Abstract:Significance: The Monte Carlo (MC) method is widely used as the gold-standard for modeling light propagation inside turbid media, such as human tissues, but combating its inherent stochastic noise requires one to simulate a large number photons, resulting in high computational burdens. Aim: We aim to develop an effective image denoising technique using deep learning (DL) to dramatically improve the low-photon MC simulation result quality, equivalently bringing further acceleration to the MC method. Approach: We developed a cascade-network combining DnCNN with UNet, while extending a range of established image denoising neural-network architectures, including DnCNN, UNet, DRUNet, and deep residual-learning for denoising MC renderings (ResMCNet), in handling three-dimensional MC data and compared their performances against model-based denoising algorithms. We also developed a simple yet effective approach to creating synthetic datasets that can be used to train DL-based MC denoisers. Results: Overall, DL-based image denoising algorithms exhibit significantly higher image quality improvements over traditional model-based denoising algorithms. Among the tested DL denoisers, our cascade network yields a 14 to 19 dB improvement in signal-to-noise ratio, which is equivalent to simulating 25 × to 78 × more photons. Other DL-based methods yielded similar results, with our method performing noticeably better with low-photon inputs and ResMCNet along with DRUNet performing better with high-photon inputs. Our cascade network achieved the highest quality when denoising complex domains, including brain and mouse atlases. Conclusions: Incorporating state-of-the-art DL denoising techniques can equivalently reduce the computation time of MC simulations by one to two orders of magnitude. Our open-source MC denoising codes and data can be freely accessed at http://mcx.space/.

Neural Temporal Denoising for Indirect Illumination

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Adversarial Monte Carlo denoising with conditioned auxiliary feature modulation

Real-time Monte Carlo Denoising with Weight Sharing Kernel Prediction Network

Frequency-Relevant Residual Learning for Multi-Modal Image Denoising.

A detail preserving neural network model for Monte Carlo denoising

Temporally Reliable Motion Vectors for Real‐time Ray Tracing

Real-Time Monte Carlo Denoising With Adaptive Fusion Network

Temporally Stable Real-Time Joint Neural Denoising and Supersampling

Robust Image Denoising Using a Virtual Flash Image for Monte Carlo Ray Tracing

Framework for denoising Monte Carlo photon transport simulations using deep learning

Fast Local Neural Regression for Low-Cost, Path Traced Lambertian Global Illumination

RL-based Stateful Neural Adaptive Sampling and Denoising for Real-Time Path Tracing

Two-Stage Monte Carlo Denoising with Adaptive Sampling and Kernel Pool

Neural Denoising for Path Tracing of Medical Volumetric Data

Neural Radiance Fields with Torch Units

Occlusion-Free Scene Recovery Via Neural Radiance Fields

Target-Aware Image Denoising for Inverse Monte Carlo Rendering

Real‐time Denoising Using BRDF Pre‐integration Factorization

Learning Model-Blind Temporal Denoisers without Ground Truths

Bayesian Collaborative Denoising for Monte Carlo Rendering