Abstract:Novel view synthesis using neural radiance fields (NeRFs) for remote sensing images is important for various applications. Traditional methods often use implicit representations for modeling, which have slow rendering speeds and cannot directly obtain the structure of the 3D scene. Some studies have introduced explicit representations, such as point clouds and voxels, but this kind of method often produces holes when processing large-scale scenes from remote sensing images. In addition, NeRFs with explicit 3D expression are more susceptible to transient phenomena (shadows and dynamic objects) and even plane holes. In order to address these issues, we propose an improved method for synthesizing new views of remote sensing images based on Point-NeRF. Our main idea focuses on two aspects: filling in the spatial structure and reconstructing ray-marching rendering using shadow information. First, we introduce hole detection, conducting inverse projection to acquire candidate points that are adjusted during training to fill the holes. We also design incremental weights to reduce the probability of pruning the plane points. We introduce a geometrically consistent shadow model based on a point cloud to divide the radiance into albedo and irradiance, allowing the model to predict the albedo of each point, rather than directly predicting the radiance. Intuitively, our proposed method uses a sparse point cloud generated with traditional methods for initialization and then builds the dense radiance field. We evaluate our method on the LEVIR_NVS data set, demonstrating its superior performance compared to state-of-the-art methods. Overall, our work provides a promising approach for synthesizing new viewpoints of remote sensing images.

HeRF: A Hierarchical Framework for Efficient and Extendable New View Synthesis

Hyb-NeRF: A Multiresolution Hybrid Encoding for Neural Radiance Fields

Efficient View Synthesis with Neural Radiance Distribution Field

SN 2 eRF: A Framework for Neural Radiance Fields given Sparse and Noisy Poses

HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces

UHDNeRF: Ultra-High-Definition Neural Radiance Fields

NeRF-SDP: Efficient Generalizable Neural Radiance Field with Scene Depth Perception.

Structured-NeRF: Hierarchical Scene Graph with Neural Representation

Adaptive Multi-NeRF: Exploit Efficient Parallelism in Adaptive Multiple Scale Neural Radiance Field Rendering

4K-NeRF: High Fidelity Neural Radiance Fields at Ultra High Resolutions

Gen-NeRF: Efficient and Generalizable Neural Radiance Fields via Algorithm-Hardware Co-Design

IOVS4NeRF:Incremental Optimal View Selection for Large-Scale NeRFs

HG3-NeRF: Hierarchical Geometric, Semantic, and Photometric Guided Neural Radiance Fields for Sparse View Inputs

VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesis

NeRFuser: Large-Scale Scene Representation by NeRF Fusion

NeRF-SR: High Quality Neural Radiance Fields Using Supersampling

InterNeRF: Scaling Radiance Fields via Parameter Interpolation

Depth Guided Fast Rendering Neural Radiance Fields

Shadow-Aware Point-Based Neural Radiance Fields for High-Resolution Remote Sensing Novel View Synthesis

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

CeRF: Convolutional Neural Radiance Fields for New View Synthesis with Derivatives of Ray Modeling