Abstract:Compared to single aperture systems, optical synthetic aperture systems greatly improve the spatial resolution, yet still exhibit a certain degree of blurring and contrast reduction. To address this challenge, numerous image restoration methods have been proposed. Recently, instead of the conventional circular synthetic aperture, the rotating rectangular synthetic aperture (RRSA) system employs a rectangular aperture to capture a sequence of images of the same scene. The RRSA system's foldable design and absence of common-phase adjustments confer cost and complexity benefits. The captured degraded image sequences contain information about multiple directions of the target scene, so it is necessary to use multi-frame image fusion technology to restore them. However, most conventional methods often introduce visual artifacts and require substantial computational time. In this paper, we propose a Dual-Domain Fusion Network (DDFNet), restoring multi-frame degraded images in the spatial and frequency domain and then achieving superior fusion results. DDFNet employs a nested U-Net architecture to capture local pixel-level relationships, facilitating the recovery of local features and structures from spatial domain images. In parallel, we transform the input images into the frequency domain, and utilize another nested U-Net for feature extraction on the normalized spectrum and phase, thereby improving the recovery of texture and edge information. Finally, the fusion model effectively utilizes multi-level features and contextual awareness to combine the spatial and frequency domain features, achieving high-quality fusion results of captured degraded sequence images. Extensive experiments demonstrate that our method achieves superior performance both in quantitative and qualitative assessments compared to state-of-the-art techniques.

ASI aurora search: an attempt of intelligent image processing for circular fisheye lens

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

Aurora Image Search With Saliency Deep Features

Saliency Deep Embedding for Aurora Image Search

Downside Hemisphere Object Detection and Localization of MAV by Fisheye Camera

Aurora Image Search with a Saliency-Weighted Region Network

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

BoSR: A CNN-based aurora image retrieval method.

Aurora image search with contextual CNN feature.

A Stronger Stitching Algorithm for Fisheye Images based on Deblurring and Registration

An integrated aurora image retrieval system: AuroraEye

AST: Annulus Swin Transformer for Pedestrians Detection under Top-view Fisheye Image.

Orientation-aware People Detection and Counting Method Based on Overhead Fisheye Camera

A Fusion Algorithm for Infrared and Visible Images Based on RDU-PCNN and ICA-bases in NSST Domain

Improved Face Detector on Fisheye Images Via Spherical-Domain Attention

Extraction of Feature Point Pseudo-Neighborhood for High-Accuracy of Fisheye Image Matching

Polar Embedding for Aurora Image Retrieval

Hierarchical Deep Embedding for Aurora Image Retrieval.

FishFormer: Annulus Slicing-based Transformer for Fisheye Rectification with Efficacy Domain Exploration

DSA: Deformable Segmentation Attention for Multi-Scale Fisheye Image Segmentation

Spatial-Angular Interaction for Light Field Image Super-Resolution