Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

Image restoration for real-world under-display imaging

Modular Degradation Simulation and Restoration for Under-Display Camera

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Fast non-iterative blind restoration of hyperspectral images with PSFs

Image Restoration for Under-Display Camera

Enhanced Coarse-to-Fine Network for Image Restoration from Under-Display Cameras.

RECOVERY AND ENHANCEMENT METHOD FOR IMAGES ACQUIRED UNDER NON-UNIFORM LIGHTING

Transform Domain Pyramidal Dilated Convolution Networks For Restoration of Under Display Camera Images

Under-Display Camera Image Restoration with Scattering Effect

Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network

Dual-Domain Network for Restoring Images from Under-Display Cameras.

54‐1: Development of UDC Image Restoration Technology Using Space Variant CNN

Under-Display Camera Image Enhancement via Cascaded Curve Estimation

Deep Video Restoration for Under-Display Camera

ISP-Agnostic Image Reconstruction for Under-Display Cameras

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

Blind Face Restoration for Under-Display Camera via Dictionary Guided Transformer

Generating Aligned Pseudo-Supervision from Non-Aligned Data for Image Restoration in Under-Display Camera

Adversarial Purification and Fine-tuning for Robust UDC Image Restoration

RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system

Decoupling Degradations with Recurrent Network for Video Restoration in Under-Display Camera