Abstract:The remote sensing 3D reconstruction of mountain areas has a wide range of applications in surveying, visualization, and game modeling. Different from indoor objects, outdoor mountain reconstruction faces additional challenges, including illumination changes, diversity of textures, and highly irregular surface geometry. Traditional neural network-based methods that lack discriminative features struggle to handle the above challenges, and thus tend to generate incomplete and inaccurate reconstructions. Truncated signed distance function (TSDF) is a commonly used parameterized representation of 3D structures, which is naturally convenient for neural network computation and computer storage. In this paper, we propose a novel deep learning method with TSDF-based representations for robust 3D reconstruction from images containing mountain terrains. The proposed method takes in a set of images captured around an outdoor mountain and produces high-quality TSDF representations of the mountain areas. To address the aforementioned challenges, such as lighting variations and texture diversity, we propose a view fusion strategy based on reweighted mechanisms (VRM) to better integrate multi-view 2D features of the same voxel. A feature enhancement (FE) module is designed for providing better discriminative geometry prior in the feature decoding process. We also propose a spatial–temporal aggregation (STA) module to reduce the ambiguity between temporal features and improve the accuracy of the reconstruction surfaces. A synthetic dataset for reconstructing images containing mountain terrains is built. Our method outperforms the previous state-of-the-art TSDF-based and depth-based reconstruction methods in terms of both 2D and 3D metrics. Furthermore, we collect real-world multi-view terrain images from Google Map. Qualitative results demonstrate the good generalization ability of the proposed method.

NeuralTPS: Learning Signed Distance Functions without Priors from Single Sparse Point Clouds

Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds Without Learning Priors

Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors

Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors

Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space Onto Surfaces

Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping

SDFMAP: Neural Signed Distance Fields for Mapping and Positioning in Real-Time

Surface Reconstruction from Point Clouds by Learning Predictive Context Priors

Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set

Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mapping

SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images

Neural 3D reconstruction from sparse views using geometric priors

Implicit Filtering for Learning Neural Signed Distance Functions from 3D Point Clouds

CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimization

MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step

PU-Ray: Domain-Independent Point Cloud Upsampling via Ray Marching on Neural Implicit Surface

3D Reconstruction of Remote Sensing Mountain Areas with TSDF-Based Neural Networks

Nonparametric Regression for 3D Point Cloud Learning

SHS-Net: Learning Signed Hyper Surfaces for Oriented Normal Estimation of Point Clouds

NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Views

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction