Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

Frequency Reciprocal Action and Fusion for Single Image Super-Resolution

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

FreqNet: A Frequency-domain Image Super-Resolution Network with Dicrete Cosine Transform

FSR: A General Frequency-Oriented Framework to Accelerate Image Super-resolution Networks.

A High-Frequency Focused Network for Lightweight Single Image Super-Resolution

Deeply Recursive Low- and High-Frequency Fusing Networks for Single Image Super-Resolution

Multi-Source Deep Residual Fusion Network for Depth Image Super-resolution

DCT-FANet: DCT based frequency attention network for single image super-resolution

Single image super resolution via wavelet transform fusion and SRFeat network

Single-image Super-Resolution Via Selective Multi-Scale Network

Frequency-Spatial Domain Feature Fusion for Spectral Super-Resolution

DFVSR: Directional Frequency Video Super-Resolution Via Asymmetric and Enhancement Alignment Network

Two-Stage Spatial-Frequency Joint Learning for Large-Factor Remote Sensing Image Super-Resolution

Single Image Super-Resolution Neural Network Using Frequency-Domain Information

High-frequency channel attention and contrastive learning for image super-resolution

Image Super-Resolution Reconstruction Model Based on Multi-Feature Fusion

Frequency-Domain Refinement with Multiscale Diffusion for Super Resolution