Abstract:Novel view synthesis using neural radiance fields (NeRFs) for remote sensing images is important for various applications. Traditional methods often use implicit representations for modeling, which have slow rendering speeds and cannot directly obtain the structure of the 3D scene. Some studies have introduced explicit representations, such as point clouds and voxels, but this kind of method often produces holes when processing large-scale scenes from remote sensing images. In addition, NeRFs with explicit 3D expression are more susceptible to transient phenomena (shadows and dynamic objects) and even plane holes. In order to address these issues, we propose an improved method for synthesizing new views of remote sensing images based on Point-NeRF. Our main idea focuses on two aspects: filling in the spatial structure and reconstructing ray-marching rendering using shadow information. First, we introduce hole detection, conducting inverse projection to acquire candidate points that are adjusted during training to fill the holes. We also design incremental weights to reduce the probability of pruning the plane points. We introduce a geometrically consistent shadow model based on a point cloud to divide the radiance into albedo and irradiance, allowing the model to predict the albedo of each point, rather than directly predicting the radiance. Intuitively, our proposed method uses a sparse point cloud generated with traditional methods for initialization and then builds the dense radiance field. We evaluate our method on the LEVIR_NVS data set, demonstrating its superior performance compared to state-of-the-art methods. Overall, our work provides a promising approach for synthesizing new viewpoints of remote sensing images.

Photogrammetry for Unconstrained Optical Satellite Imagery with Combined Neural Radiance Fields

NeIF: Representing General Reflectance as Neural Intrinsics Fields for Uncalibrated Photometric Stereo

Remote Sensing Neural Radiance Fields for Multi-View Satellite Photogrammetry

High Spatial-Resolution Classification of Urban Surfaces Using a Deep Learning Method

Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetry

Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Cameras

BRDF-NeRF: Neural Radiance Fields with Optical Satellite Images and BRDF Modelling

SPARSESAT-NERF: DENSE DEPTH SUPERVISED NEURAL RADIANCE FIELDS FOR SPARSE SATELLITE IMAGES

Constraining the Geometry of NeRFs for Accurate DSM Generation from Multi-View Satellite Images

Unmanned Aerial Vehicle-Neural Radiance Field (UAV-NeRF): Learning Multiview Drone Three-Dimensional Reconstruction with Neural Radiance Field

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Shadow-Aware Point-Based Neural Radiance Fields for High-Resolution Remote Sensing Novel View Synthesis

Fast Satellite Tensorial Radiance Field for Multi-date Satellite Imagery of Large Size

True orthophoto generation from unmanned aerial vehicle imagery using neural radiance fields with multi-resolution hash encoding

3D Reconstruction Method of Space Target on Optical Images with Wide Baseline via Neural Radiance Field

Urban Radiance Fields

Exploring Seasonal Variability in the Context of Neural Radiance Fields for 3D Reconstruction on Satellite Imagery

SatensoRF: Fast Satellite Tensorial Radiance Field for Multi-date Satellite Imagery of Large Size

psPRF:Pansharpening Planar Neural Radiance Field for Generalized 3D Reconstruction Satellite Imagery

Self-Aligning Depth-regularized Radiance Fields for Asynchronous RGB-D Sequences

Sat-Mesh: Learning Neural Implicit Surfaces for Multi-View Satellite Reconstruction