Abstract:Significance: The Monte Carlo (MC) method is widely used as the gold-standard for modeling light propagation inside turbid media, such as human tissues, but combating its inherent stochastic noise requires one to simulate a large number photons, resulting in high computational burdens. Aim: We aim to develop an effective image denoising technique using deep learning (DL) to dramatically improve the low-photon MC simulation result quality, equivalently bringing further acceleration to the MC method. Approach: We developed a cascade-network combining DnCNN with UNet, while extending a range of established image denoising neural-network architectures, including DnCNN, UNet, DRUNet, and deep residual-learning for denoising MC renderings (ResMCNet), in handling three-dimensional MC data and compared their performances against model-based denoising algorithms. We also developed a simple yet effective approach to creating synthetic datasets that can be used to train DL-based MC denoisers. Results: Overall, DL-based image denoising algorithms exhibit significantly higher image quality improvements over traditional model-based denoising algorithms. Among the tested DL denoisers, our cascade network yields a 14 to 19 dB improvement in signal-to-noise ratio, which is equivalent to simulating 25 × to 78 × more photons. Other DL-based methods yielded similar results, with our method performing noticeably better with low-photon inputs and ResMCNet along with DRUNet performing better with high-photon inputs. Our cascade network achieved the highest quality when denoising complex domains, including brain and mouse atlases. Conclusions: Incorporating state-of-the-art DL denoising techniques can equivalently reduce the computation time of MC simulations by one to two orders of magnitude. Our open-source MC denoising codes and data can be freely accessed at http://mcx.space/.

A machine learning approach for filtering Monte Carlo noise

Multinoise-type Blind Denoising Using a Single Uniform Deep Convolutional Neural Network.

Real-time Monte Carlo Denoising with Weight Sharing Kernel Prediction Network

Image Denoising Based On A Cnn Model

A detail preserving neural network model for Monte Carlo denoising

Deep Filtering with DNN, CNN and RNN

A survey on deep learning-based Monte Carlo denoising

A Simple And Effective Filtering Scheme For Improving Neural Fields

Adversarial Monte Carlo denoising with conditioned auxiliary feature modulation

Denoising Deep Monte Carlo Renderings

Deep Learning Based Filtering Algorithm for Noise Removal in Underwater Images

Point-wise Adaptive Filtering for Fast Monte Carlo Noise Reduction

Path‐based Monte Carlo Denoising Using a Three‐Scale Neural Network

Progressive Denoising of Monte Carlo Rendered Images

Deep residual learning for denoising Monte Carlo renderings

Framework for denoising Monte Carlo photon transport simulations using deep learning

Bayesian Collaborative Denoising for Monte Carlo Rendering

Image Denoising Using NLM Filtering and Convolutional Neural Network

Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder

An end-to-end deep learning model for robust smooth filtering identification

3D Filtering by Block Matching and Convolutional Neural Network for Image Denoising