Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

Distorted image restoration via non-rigid registration and lucky-region fusion approach

Split-attention Multiframe Alignment Network for Image Restoration

Reconstruction of underwater images with distortion using robust image registration

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

An improved image restoration approach using adaptive local constraint

Research on Distortion-free Fusion of Sequence Images

A two-stage restoration of distorted underwater images using compressive sensing and image registration

Image Restoration Based on Combined Dark Channel and Image Registration

Registration of images with affine geometric distortion based on Maximally Stable Extremal Regions and phase congruency

A novel image registration method based on edge fitting

Distortion-driven Turbulence Effect Removal using Variational Model.

Geometric Registration Based on Distortion Estimation

An Iterative SIFT Based on Intensity and Spatial Information for Remote Sensing Image Registration

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

A Fast Image Deformity Correction Algorithm for Underwater Turbulent Image Distortion

Automatic Registration of Airborne Images with Complex Local Distortion

An efficient deep learning-based framework for image distortion correction

Non-rigid medical image registration using optical flow and locally-refined multilevel free form deformation

Reconstruction of Spatially Misaligned and Turbulence Degraded Images

Robust image restoration via adaptive low-rank approximation and joint kernel regression.

Multispectral Registration Algorithm Based on Fusion of Infrared and Color Images