Abstract:In the domain of synthetic aperture radar (SAR) image processing, a prevalent issue persists wherein research predominantly focuses on single-task learning, often neglecting the concurrent impact of speckle noise and low resolution on SAR images. Currently, there are two main processing strategies. The first strategy involves conducting speckle reduction and super-resolution processing step by step. The second strategy involves performing speckle reduction as an auxiliary step, with a focus on enhancing the primary task of super-resolution processing. However, both of these strategies exhibit clear deficiencies. Nevertheless, both tasks jointly focus on two key aspects, enhancing SAR quality and restoring details. The fusion of these tasks can effectively leverage their task correlation, leading to a significant improvement in processing effectiveness. Additionally, multi-temporal SAR images covering imaging information from different time periods exhibit high correlation, providing deep learning models with a more diverse feature expression space, greatly enhancing the model's ability to address complex issues. Therefore, this study proposes a deep learning network for integrated speckle reduction and super-resolution in multi-temporal SAR (ISSMSAR). The network aims to reduce speckle in multi-temporal SAR while significantly improving the image resolution. Specifically, it consists of two subnetworks, each taking the SAR image at time 1 and the SAR image at time 2 as inputs. Each subnetwork includes a primary feature extraction block (PFE), a high-level feature extraction block (HFE), a multi-temporal feature fusion block (FFB), and an image reconstruction block (REC). Following experiments on diverse data sources, the results demonstrate that ISSMSAR surpasses speckle reduction and super-resolution methods based on a single task in terms of both subjective perception and objective evaluation metrics regarding the quality of image restoration.

Exploiting multi-temporal information for improved speckle reduction of Sentinel-1 SAR images by deep learning

Multi-temporal speckle reduction with self-supervised deep neural networks

Fast strategies for multi-temporal speckle reduction of Sentinel-1 GRD images

SAR2SAR: a semi-supervised despeckling algorithm for SAR images

Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1

Deep Learning for Integrated Speckle Reduction and Super-Resolution in Multi-Temporal SAR

SAR Image Despeckling by Deep Neural Networks: from a pre-trained model to an end-to-end training strategy

An Advanced SAR Image Despeckling Method by Bernoulli-Sampling-Based Self-Supervised Deep Learning

SAR Despeckling Using Multiobjective Neural Network Trained with Generic Statistical Samples.

A review of deep-learning techniques for SAR image restoration

Robust SAR Image Despeckling by Deep Learning from Near-Real Datasets

A deep neural network learning‐based speckle noise removal technique for enhancing the quality of synthetic‐aperture radar images

Speckle2Void: Deep Self-Supervised SAR Despeckling with Blind-Spot Convolutional Neural Networks

A Self-supervised SAR Image Despeckling Strategy Based on Parameter-sharing Convolutional Neural Networks

SAR Image Despeckling Based on Denoising Diffusion Probabilistic Model and Swin Transformer

SAR Image Despeckling Based on Block-Matching and Noise-Referenced Deep Learning Method

Adaptive Speckle Filter for Multi-Temporal PolSAR Image with Multi-Dimensional Information Fusion

SAR Image Despeckling by Noisy Reference-Based Deep Learning Method

SAR Speckle Removal Using Hybrid Frequency Modulations

Enhancing RABASAR for Multi-Temporal SAR Image Despeckling through Directional Filtering and Wavelet Transform

Deep Unrolling Network for SAR Image Despeckling