Abstract:Novel view synthesis using neural radiance fields (NeRFs) for remote sensing images is important for various applications. Traditional methods often use implicit representations for modeling, which have slow rendering speeds and cannot directly obtain the structure of the 3D scene. Some studies have introduced explicit representations, such as point clouds and voxels, but this kind of method often produces holes when processing large-scale scenes from remote sensing images. In addition, NeRFs with explicit 3D expression are more susceptible to transient phenomena (shadows and dynamic objects) and even plane holes. In order to address these issues, we propose an improved method for synthesizing new views of remote sensing images based on Point-NeRF. Our main idea focuses on two aspects: filling in the spatial structure and reconstructing ray-marching rendering using shadow information. First, we introduce hole detection, conducting inverse projection to acquire candidate points that are adjusted during training to fill the holes. We also design incremental weights to reduce the probability of pruning the plane points. We introduce a geometrically consistent shadow model based on a point cloud to divide the radiance into albedo and irradiance, allowing the model to predict the albedo of each point, rather than directly predicting the radiance. Intuitively, our proposed method uses a sparse point cloud generated with traditional methods for initialization and then builds the dense radiance field. We evaluate our method on the LEVIR_NVS data set, demonstrating its superior performance compared to state-of-the-art methods. Overall, our work provides a promising approach for synthesizing new viewpoints of remote sensing images.

Area-NeRF: Area-based Neural Radiance Fields

PointNeRF++: A multi-scale, point-based Neural Radiance Field

SG-NeRF: Semantic-guided Point-based Neural Radiance Fields

Dip-NeRF: Depth-Based Anti-Aliased Neural Radiance Fields

Improving Neural Radiance Field using Near-Surface Sampling with Point Cloud Generation

Planar Reflection-Aware Neural Radiance Fields

Learning-based Ray Sampling Strategy for Computation Efficient Neural Radiance Field Generation

Efficient Ray Sampling for Radiance Fields Reconstruction

Cross-Ray Neural Radiance Fields for Novel-view Synthesis from Unconstrained Image Collections

Efficient View Synthesis with Neural Radiance Distribution Field

SN 2 eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses

Prior-Driven NeRF: Prior Guided Rendering

NeRF-SDP: Efficient Generalizable Neural Radiance Field with Scene Depth Perception.

NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review

Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation

NeRF synthesis with shading guidance

Enhancing Neural Radiance Fields with Depth and Normal Completion Priors from Sparse Views

NeRFReN: Neural Radiance Fields with Reflections

fNeRF: High Quality Radiance Fields from Practical Cameras

Shadow-Aware Point-Based Neural Radiance Fields for High-Resolution Remote Sensing Novel View Synthesis

AG-NeRF: Attention-guided Neural Radiance Fields for Multi-height Large-scale Outdoor Scene Rendering