Abstract:This study introduces a novel satellite image digital surface model (DSM) reconstruction framework grounded in deep learning methodology. The proposed framework effectively utilizes a rational polynomial camera (RPC) model to establish the mapping relationship between image coordinates and geographic coordinates. Given the expansive coverage and abundant ground object data inherent in satellite images, we designed a lightweight deep network model. This model facilitates both coarse and fine estimation of a height map through two distinct stages. Our approach harnesses shallow and deep image information via a feature extraction module, subsequently employing RPC Warping to construct feature volumes for various angles. We employ variance as a similarity metric to achieve image matching and derive the fused cost volume. Following this, we aggregate cost information across different scales and height directions using a regularization module. This process yields the confidence level of the current height plane, which is then regressed to predict the height map. Once the height map from stage 1 is obtained, we gauge the prediction's uncertainty based on the variance in the probability distribution in the height direction. This allows us to adjust the height estimation range according to this uncertainty, thereby enabling precise height value prediction in stage 2. After conducting geometric consistency detection filtering of fine height maps from diverse viewpoints, we generate 3D point clouds through the inverse projection of RPC models. Finally, we resample these 3D point clouds to produce high-precision DSM products. By analyzing the results of our method's height map predictions and comparing them with existing deep learning-based reconstruction methods, we assess the DSM reconstruction performance of our proposed framework. The experimental findings underscore the robustness of our method against discontinuous regions, occlusions, uneven illumination areas in satellite imagery, and weak texture regions during height map generation. Furthermore, the reconstructed digital surface model (DSM) surpasses existing solutions in terms of completeness and root mean square error metrics while concurrently reducing the model parameters by 42.93%. This optimization markedly diminishes memory usage, thereby conserving both software and hardware resources as well as system overhead. Such savings pave the way for a more efficient system design and development process.

Satellite anomaly detection based on reconstruction discrepancy theory utilizing a new dual-branch reconstruction model

Segmenting Remote Sensing Anomalies at Instance-level Via Anomaly Map Guided Adaptation

Pico-satellite telemetry anomaly detection through clustering

AnomalyCD: A Benchmark for Earth Anomaly Change Detection with High-Resolution and Time-Series Observations

Satellite Early Anomaly Detection Using an Advanced Transformer Architecture for Non-Stationary Telemetry Data

A Unified Framework for Anomaly Detection of Satellite Images Based on Well-Designed Features and an Artificial Neural Network

Anomaly Detection of Satellite Telemetry Data Based on Extended Dominant Sets Clustering

MOON: A Subspace-Based Multi-Branch Network for Object Detection in Remotely Sensed Images

Large-Kernel Central Block Masked Convolution and Channel Attention-Based Reconstruction Network for Anomaly Detection of High-Resolution Hyperspectral Imagery

Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data

Deep Learning-Based Digital Surface Model Reconstruction of ZY-3 Satellite Imagery

Simulation-Aided SAR Target Classification via Dual-Branch Reconstruction and Subdomain Alignment

Radar Echo Reconstruction in Oceanic Area via Deep Learning of Satellite Data

Unified Model Based on Reinforced Feature Reconstruction for Metro Track Anomaly Detection

Unsupervised Anomaly Detection for Surface Defects with Dual-Siamese Network

Missing Data Reconstruction in Remote Sensing image with a Unified Spatial-Temporal-Spectral Deep Convolutional Neural Network

Anomaly Segmentation for High-Resolution Remote Sensing Images Based on Pixel Descriptors

Asynchronous Autoregressive Prediction for Satellite Anomaly Detection

Unraveling the "Anomaly" in Time Series Anomaly Detection: A Self-supervised Tri-domain Solution

A task of anomaly detection for a smart satellite Internet of things system

Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial Decoders