Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

54‐1: Development of UDC Image Restoration Technology Using Space Variant CNN

Image restoration for real-world under-display imaging

Modular Degradation Simulation and Restoration for Under-Display Camera

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Enhanced Coarse-to-Fine Network for Image Restoration from Under-Display Cameras.

Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network

Dual-Domain Network for Restoring Images from Under-Display Cameras.

Transform Domain Pyramidal Dilated Convolution Networks For Restoration of Under Display Camera Images

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

Image Restoration for Under-Display Camera

Under-Display Camera Image Enhancement via Cascaded Curve Estimation

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Under-Display Camera Image Restoration with Scattering Effect

Variational Deep Image Restoration

Decoupling Degradations with Recurrent Network for Video Restoration in Under-Display Camera

Deep Video Restoration for Under-Display Camera

Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network

Adversarial Purification and Fine-tuning for Robust UDC Image Restoration

Image Restoration Via UAVFormer for Under-Display Camera of UAV.

Single-shot image restoration via a model-enhanced network with unpaired supervision in an optical sparse aperture system