Abstract:We propose a simple yet effective neural network-based framework for global illumination rendering. Recently, rendering techniques that learn neural radiance caches by minimizing the difference (i.e., residual) between the left and right sides of the rendering equation have been suggested. Due to their ease of implementation and the advantage of excluding path integral calculations, these techniques have been applied to various fields, such as free-viewpoint rendering, differentiable rendering, and real-time rendering. However, issues of slow training and occasionally darkened renders have been noted. We identify the cause of these issues as the bias and high variance present in the gradient estimates of the existing residual-based objective function. To address this, we introduce a new objective function that maintains the same global optimum as before but allows for unbiased and low-variance gradient estimates, enabling faster and more accurate training of neural networks. In conclusion, this method is simply implemented by ignoring the partial derivatives of the right-hand side, and theoretical and experimental analyses demonstrate the effectiveness of the proposed loss.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve two key problems in the field of neural rendering: **slow training speed** and **inaccurate rendering results**. Specifically, the author points out some defects in the existing neural cache methods based on residual optimization during the training process, and proposes a new optimization method - **semi - gradient method** to solve these problems. #### Problems of existing methods 1. **Slow training speed**: - When using the residual - based optimization method, the convergence speed on the right - hand side (RHS) is much faster than that on the left - hand side (LHS), resulting in low overall training efficiency. - High - variance and - bias gradient estimates affect the convergence speed of the model. 2. **Inaccurate rendering results**: - Biased gradient estimates can cause errors in the model during the training process, and ultimately affect the quality of the rendering results, such as the image being too dark, color distortion, etc. #### Proposed solutions To overcome these problems, the author proposes the **semi - gradient method**, whose core idea is to ignore the partial derivative on the right - hand side (RHS) and only optimize the left - hand side (LHS). Specific improvements include: 1. **Eliminate bias**: - The semi - gradient method avoids the gradient bias caused by the randomness and noise of Monte Carlo integration (MC integration) by ignoring the partial derivative on the right - hand side. 2. **Reduce variance**: - Ignoring the partial derivative on the right - hand side reduces the variance in the gradient estimate, thereby improving the training stability. 3. **Accelerate convergence**: - The experimental results show that the semi - gradient method can significantly reduce the error under the same number of training iterations, on average reducing the relative mean - squared error (RelMSE) by 8.8 times, and reducing the training time by 25 - 30%. ### Summary This paper solves the problems of slow training speed and inaccurate rendering results in the existing neural rendering techniques by introducing the semi - gradient method, thereby achieving faster and more accurate neural rendering.

Fast and Accurate Neural Rendering Using Semi-Gradients

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache

Neural Global Illumination Via Superposed Deformable Feature Fields

Neural Global Illumination: Interactive Indirect Illumination Prediction Under Dynamic Area Lights

On the Use of Deep Active Semi-Supervised Learning for Fast Rendering in Global Illumination

Deep convolutional reconstruction for gradient-domain rendering

LightFormer: Light-Oriented Global Neural Rendering in Dynamic Scene

GaNI: Global and Near Field Illumination Aware Neural Inverse Rendering

Fast Local Neural Regression for Low-Cost, Path Traced Lambertian Global Illumination

Volume Feature Rendering for Fast Neural Radiance Field Reconstruction

Dynamic Neural Radiosity with Multi-grid Decomposition

Unsupervised Image Reconstruction for Gradient‐Domain Volumetric Rendering

AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields

Lightweight Bilateral Convolutional Neural Networks for Real-time Diffuse Global Illumination

Cascaded and Generalizable Neural Radiance Fields for Fast View Synthesis

Adaptive Multi-NeRF: Exploit Efficient Parallelism in Adaptive Multiple Scale Neural Radiance Field Rendering

Anisotropic Neural Representation Learning for High-Quality Neural Rendering

Neural Shading Fields for Efficient Facial Inverse Rendering

Neural Relightable Participating Media Rendering

Object-Based Illumination Estimation with Rendering-Aware Neural Networks

Accelerated Neural Radiation Field Based on Optimal Ray Sampling