Abstract:The remote sensing 3D reconstruction of mountain areas has a wide range of applications in surveying, visualization, and game modeling. Different from indoor objects, outdoor mountain reconstruction faces additional challenges, including illumination changes, diversity of textures, and highly irregular surface geometry. Traditional neural network-based methods that lack discriminative features struggle to handle the above challenges, and thus tend to generate incomplete and inaccurate reconstructions. Truncated signed distance function (TSDF) is a commonly used parameterized representation of 3D structures, which is naturally convenient for neural network computation and computer storage. In this paper, we propose a novel deep learning method with TSDF-based representations for robust 3D reconstruction from images containing mountain terrains. The proposed method takes in a set of images captured around an outdoor mountain and produces high-quality TSDF representations of the mountain areas. To address the aforementioned challenges, such as lighting variations and texture diversity, we propose a view fusion strategy based on reweighted mechanisms (VRM) to better integrate multi-view 2D features of the same voxel. A feature enhancement (FE) module is designed for providing better discriminative geometry prior in the feature decoding process. We also propose a spatial–temporal aggregation (STA) module to reduce the ambiguity between temporal features and improve the accuracy of the reconstruction surfaces. A synthetic dataset for reconstructing images containing mountain terrains is built. Our method outperforms the previous state-of-the-art TSDF-based and depth-based reconstruction methods in terms of both 2D and 3D metrics. Furthermore, we collect real-world multi-view terrain images from Google Map. Qualitative results demonstrate the good generalization ability of the proposed method.

3d Terrain Recovery From A Single Image Based Onminimizationalgorithm

A Novel Method Of Camera Self-Positioning - Matching Image Contour Lines Of Mountains

On accurate recovery of 3D surface normal using minimum 2D images

Camera Parameter Recovery by Matching Image Contour Lines of Hills

Prior surface model guided dense reconstruction via graph-cuts

Multi-resolution Terrain Rendering Using Summed-Area Tables .

Recovery Of 3d Depth Map From Image Shading For Underwater Applications

3D Reconstruction of Remote Sensing Mountain Areas with TSDF-Based Neural Networks

3-D Shape Recovery of Planar and Curved Surfaces from Shading Cues in Underwater Images

A Shape From Shading Algorithm And Its Application

Terrain Reconstruction from Contours by Skeleton Extraction Using Delaunay Triangulation and Voronoi Diagram

Recovering Surface Details under General Unknown Illumination Using Shading and Coarse Multi-view Stereo

One method on building 3D terrain landscape dynamically

Shading-Based Surface Detail Recovery under General Unknown Illumination

Texture-less surface reconstruction using shape-based image augmentation

Shadow Detection and Reconstruction of High-Resolution Remote Sensing Images in Mountainous and Hilly Environments

A Method for Extracting Some Key Terrain Features from Shaded Relief of Digital Terrain Models

A Method for 3D Reconstruction of Complex Scenes from Two Uncalibrated Views

Monocular 3d Shape Recovery Of Inextensibility Deformable Surface By Using De-Based Niching Algorithm With Partial Reinitialization

Survey On Simplification Algorithm For Large-Scale Terrain Modeling

Research on 3D Terrain Generation and Visualization