Abstract:This study introduces a novel satellite image digital surface model (DSM) reconstruction framework grounded in deep learning methodology. The proposed framework effectively utilizes a rational polynomial camera (RPC) model to establish the mapping relationship between image coordinates and geographic coordinates. Given the expansive coverage and abundant ground object data inherent in satellite images, we designed a lightweight deep network model. This model facilitates both coarse and fine estimation of a height map through two distinct stages. Our approach harnesses shallow and deep image information via a feature extraction module, subsequently employing RPC Warping to construct feature volumes for various angles. We employ variance as a similarity metric to achieve image matching and derive the fused cost volume. Following this, we aggregate cost information across different scales and height directions using a regularization module. This process yields the confidence level of the current height plane, which is then regressed to predict the height map. Once the height map from stage 1 is obtained, we gauge the prediction's uncertainty based on the variance in the probability distribution in the height direction. This allows us to adjust the height estimation range according to this uncertainty, thereby enabling precise height value prediction in stage 2. After conducting geometric consistency detection filtering of fine height maps from diverse viewpoints, we generate 3D point clouds through the inverse projection of RPC models. Finally, we resample these 3D point clouds to produce high-precision DSM products. By analyzing the results of our method's height map predictions and comparing them with existing deep learning-based reconstruction methods, we assess the DSM reconstruction performance of our proposed framework. The experimental findings underscore the robustness of our method against discontinuous regions, occlusions, uneven illumination areas in satellite imagery, and weak texture regions during height map generation. Furthermore, the reconstructed digital surface model (DSM) surpasses existing solutions in terms of completeness and root mean square error metrics while concurrently reducing the model parameters by 42.93%. This optimization markedly diminishes memory usage, thereby conserving both software and hardware resources as well as system overhead. Such savings pave the way for a more efficient system design and development process.

Compressive-Sensing Reconstruction for Satellite Monitor Data Using a Deep Generative Model

Intelligent Reconstruction for Spatially Irregular Seismic Data by Combining Compressed Sensing with Deep Learning

A Fast Sparsity-Free Compressive Sensing Approach for Vibration Data Reconstruction Using Deep Convolutional GAN

Training deep learning based image denoisers from undersampled measurements without ground truth and without image prior

High efficient optical remote sensing images acquisition for Nano-satellite: reconstruction algorithms

SatDM: Synthesizing Realistic Satellite Image with Semantic Layout Conditioning using Diffusion Models

Learning Satellite Image Recovery Through Turbulence

Deep Learning-Based Digital Surface Model Reconstruction of ZY-3 Satellite Imagery

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Robust Multitask Compressive Sampling Via Deep Generative Models for Crack Detection in Structural Health Monitoring

Lost data reconstruction for structural health monitoring using deep convolutional generative adversarial networks

Deep Compressed Sensing Based Data Imputation for Urban Environmental Monitoring

Model-informed deep learning-based compressive sensing for resampling and recovering 2D SHM vision data

Recovering compressed images for automatic crack segmentation using generative models

Compressed Sensing MRI by Integrating Deep Denoiser and Weighted Schatten P-Norm Minimization

Reconstruction Technique Based on the Theory of Compressed Sensing Satellite Images

Compressive Sensing Spatially Adaptive Total Variation Method for High-Noise Astronomical Image Denoising

Sensor-Data Reconstruction for Helicopter Structural-Health Monitoring Using Deep Learning

Deep learning seismic damage assessment with embedded signal denoising considering three-dimensional time-frequency feature correlation

Compressive-sensing data reconstruction for structural health monitoring: a machine-learning approach

Seismic data recovery using deep targeted denoising priors in an alternating optimization framework