Abstract:This study introduces a novel satellite image digital surface model (DSM) reconstruction framework grounded in deep learning methodology. The proposed framework effectively utilizes a rational polynomial camera (RPC) model to establish the mapping relationship between image coordinates and geographic coordinates. Given the expansive coverage and abundant ground object data inherent in satellite images, we designed a lightweight deep network model. This model facilitates both coarse and fine estimation of a height map through two distinct stages. Our approach harnesses shallow and deep image information via a feature extraction module, subsequently employing RPC Warping to construct feature volumes for various angles. We employ variance as a similarity metric to achieve image matching and derive the fused cost volume. Following this, we aggregate cost information across different scales and height directions using a regularization module. This process yields the confidence level of the current height plane, which is then regressed to predict the height map. Once the height map from stage 1 is obtained, we gauge the prediction's uncertainty based on the variance in the probability distribution in the height direction. This allows us to adjust the height estimation range according to this uncertainty, thereby enabling precise height value prediction in stage 2. After conducting geometric consistency detection filtering of fine height maps from diverse viewpoints, we generate 3D point clouds through the inverse projection of RPC models. Finally, we resample these 3D point clouds to produce high-precision DSM products. By analyzing the results of our method's height map predictions and comparing them with existing deep learning-based reconstruction methods, we assess the DSM reconstruction performance of our proposed framework. The experimental findings underscore the robustness of our method against discontinuous regions, occlusions, uneven illumination areas in satellite imagery, and weak texture regions during height map generation. Furthermore, the reconstructed digital surface model (DSM) surpasses existing solutions in terms of completeness and root mean square error metrics while concurrently reducing the model parameters by 42.93%. This optimization markedly diminishes memory usage, thereby conserving both software and hardware resources as well as system overhead. Such savings pave the way for a more efficient system design and development process.

CNN-Based Large Area Pixel-Resolution Topography Retrieval From Single-View LROC NAC Images Constrained With SLDEM

Lunar Crater Detection on Digital Elevation Model: A Complete Workflow Using Deep Learning and Its Application

ELunarDTMNet: Efficient Reconstruction of High-Resolution Lunar DTM From Single-View Orbiter Images

LODM: Large-scale Online Dense Mapping for UAV

Terrain Reconstruction of Lunar Surface Based on Binocular Fisheye Camera

Large Area High-Resolution 3D Mapping of the Von Kármán Crater: Landing Site for the Chang’E-4 Lander and Yutu-2 Rover

High-Resolution Terrain Modeling Using Airborne LiDAR Data with Transfer Learning

TTSR: A Transformer-Based Topography Neural Network for Digital Elevation Model Super-Resolution

LTRNet: A Lightweight Topography Recognition Network

Subpixel-Scale Topography Retrieval of Mars Using Single-Image DTM Estimation and Super-Resolution Restoration

A Multi-Scale Mapping Approach Based on a Deep Learning CNN Model for Reconstructing High-Resolution Urban DEMs

The Generation of High-Resolution Mapping Products for the Lunar South Pole Using Photogrammetry and Photoclinometry

DEM super-resolution framework based on deep learning: decomposing terrain trends and residuals

Deep Learning-Based Digital Surface Model Reconstruction of ZY-3 Satellite Imagery

Reconstructing High-Resolution DEMs from 3D Terrain Features Using Conditional Generative Adversarial Networks

Highly Applicable Iterative Network for 3-D Reconstruction Based on Multiview Satellite Images

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

Integrating Topographic Skeleton into Deep Learning for Terrain Reconstruction from GDEM and Google Earth Image

3D Virtual Urban Scene Reconstruction from a Single Optical Remote Sensing Image.

Onboard Real-Time Dense Reconstruction in Large Terrain Scene Using Embedded UAV Platform

Super-resolution Reconstruction of a 3 Arc-Second Global DEM Dataset.