Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

Research on Distortion-free Fusion of Sequence Images

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Fusion Algorithm of Laser-Point Clouds and Optical Images

Distorted image restoration via non-rigid registration and lucky-region fusion approach

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Multi-Spectral Image Fusion Based On Fractal Features

The Realistic Fusion of Multi-spectral Images

An image fusion algorithm based on image clustering theory

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Infrared and visible image fusion algorithm based on spatial domain and image features

An Image Fusion Algorithm Using Spatial Consistency and Bands Correlation

A two-stage restoration of distorted underwater images using compressive sensing and image registration

A fast multi-resolution image fusion method based on visual features

A Fast Image Deformity Correction Algorithm for Underwater Turbulent Image Distortion

Infrared and Visible Light Image Sequences Fusion Scheme Based on Region Target Detection

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

Distortion-driven Turbulence Effect Removal using Variational Model.

A multifeature fusion method for the color distortion and low contrast of underwater images

OPTICAL AND SAR IMAGE FUSION BASED ON VISUAL SALIENCY FEATURES

Novel Multi-Resolution Image Fusion Algorithm Based on Kalman Filtering