Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

Data-Driven Redundant Transform Based on Parseval Frames

Learning Redundant Sparsifying Transform Based on Equi-Angular Frame.

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Stable Sparse Model with Non-Tight Frame

Interpolation and Denoising of High-Dimensional Seismic Data by Learning a Tight Frame

Hyperspectral Imagery Denoising Via Reweighed Sparse Low-Rank Nonnegative Tensor Factorization

Seismic Data Interpolation and Denoising by Learning a Tensor Tight Frame

Learning Sparse Frame Models for Natural Image Patterns

Learned Multi-layer Residual Sparsifying Transform Model for Low-dose CT Reconstruction

Frame-based Sparse Analysis and Synthesis Signal Representations and Parseval K-SVD

A new Image Decomposition Approach using Pixel-wise Analysis Sparsity Model

CT Image Reconstruction by Spatial-Radon Domain Data-Driven Tight Frame Regularization

Learning Filter Bank Sparsifying Transforms

VIDOSAT: High-dimensional Sparsifying Transform Learning for Online Video Denoising

Single Image Restoration Through ℓ2-Relaxed Truncated ℓ0 Analysis-Based Sparse Optimization in Tight Frames

Seismic data denoising via shearlet transform and data‐driven tight frame

Optimally Sparse Frames

A Patch-Based Low-Rank Tensor Approximation Model for Multiframe Image Denoising.

Undersampled MR Image Reconstruction with Data-Driven Tight Frame

Two-layer Residual Sparsifying Transform Learning for Image Reconstruction