Abstract:This study introduces a novel satellite image digital surface model (DSM) reconstruction framework grounded in deep learning methodology. The proposed framework effectively utilizes a rational polynomial camera (RPC) model to establish the mapping relationship between image coordinates and geographic coordinates. Given the expansive coverage and abundant ground object data inherent in satellite images, we designed a lightweight deep network model. This model facilitates both coarse and fine estimation of a height map through two distinct stages. Our approach harnesses shallow and deep image information via a feature extraction module, subsequently employing RPC Warping to construct feature volumes for various angles. We employ variance as a similarity metric to achieve image matching and derive the fused cost volume. Following this, we aggregate cost information across different scales and height directions using a regularization module. This process yields the confidence level of the current height plane, which is then regressed to predict the height map. Once the height map from stage 1 is obtained, we gauge the prediction's uncertainty based on the variance in the probability distribution in the height direction. This allows us to adjust the height estimation range according to this uncertainty, thereby enabling precise height value prediction in stage 2. After conducting geometric consistency detection filtering of fine height maps from diverse viewpoints, we generate 3D point clouds through the inverse projection of RPC models. Finally, we resample these 3D point clouds to produce high-precision DSM products. By analyzing the results of our method's height map predictions and comparing them with existing deep learning-based reconstruction methods, we assess the DSM reconstruction performance of our proposed framework. The experimental findings underscore the robustness of our method against discontinuous regions, occlusions, uneven illumination areas in satellite imagery, and weak texture regions during height map generation. Furthermore, the reconstructed digital surface model (DSM) surpasses existing solutions in terms of completeness and root mean square error metrics while concurrently reducing the model parameters by 42.93%. This optimization markedly diminishes memory usage, thereby conserving both software and hardware resources as well as system overhead. Such savings pave the way for a more efficient system design and development process.

ImpliCity: City Modeling from Satellite Images with Deep Implicit Occupancy Fields

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

City-scale Continual Neural Semantic Mapping with Three-Layer Sampling and Panoptic Representation

Efficient Implicit Neural Reconstruction Using LiDAR

Modeling Urban Scenes In The Spatial-Temporal Space

Efficient 3D reconstruction for urban scenes

DENSER Cities: A System for Dense Efficient Reconstructions of Cities

3D Virtual Urban Scene Reconstruction from a Single Optical Remote Sensing Image.

Sat-Mesh: Learning Neural Implicit Surfaces for Multi-View Satellite Reconstruction

Automatic Deep Inference of Procedural Cities from Global-scale Spatial Data

DeepMIF: Deep Monotonic Implicit Fields for Large-Scale LiDAR 3D Mapping

Deep Learning-Based Digital Surface Model Reconstruction of ZY-3 Satellite Imagery

ResDepth: A Deep Residual Prior For 3D Reconstruction From High-resolution Satellite Images

City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds

Simultaneous Extraction of Spatial and Attributional Building Information Across Large-Scale Urban Landscapes from High-Resolution Satellite Imagery

Fusing Spaceborne Sar Interferometry And Street View Images For 4d Urban Modeling

Neighborhood-based Neural Implicit Reconstruction from Point Clouds

3D building reconstruction from single street view images using deep learning

A Framework for Reconstructing Building Parametric Models with Hierarchical Relationships from Point Clouds.

Dense 3D Surface Reconstruction of Large-Scale Streetscape from Vehicle-Borne Imagery and LiDAR

Automatic 3D Building Reconstruction from Multi-View Aerial Images with Deep Learning