Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

Enhanced Coarse-to-Fine Network for Image Restoration from Under-Display Cameras.

Modular Degradation Simulation and Restoration for Under-Display Camera

Image restoration for real-world under-display imaging

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

MEFNet: Multi-scale Event Fusion Network for Motion Deblurring

Dual-Domain Network for Restoring Images from Under-Display Cameras.

Transform Domain Pyramidal Dilated Convolution Networks For Restoration of Under Display Camera Images

MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results

Under-Display Camera Image Enhancement via Cascaded Curve Estimation

Image Restoration for Under-Display Camera

Decoupling Degradations with Recurrent Network for Video Restoration in Under-Display Camera

Under-Display Camera Image Restoration with Scattering Effect

Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Adversarial Purification and Fine-tuning for Robust UDC Image Restoration

Blind Face Restoration for Under-Display Camera via Dictionary Guided Transformer

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Deep Video Restoration for Under-Display Camera

CRNet: A Detail-Preserving Network for Unified Image Restoration and Enhancement Task

54‐1: Development of UDC Image Restoration Technology Using Space Variant CNN

DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement