Abstract:With the wide application of high resolution imaging technology in terrain mapping, astronomical observation and military reconnaissance, the imaging resolution of optical system is more and more demanding. According to the diffraction limit and Rayleigh criterion, the imaging resolution of the optical system is proportional to the size of the aperture of the system, but affected by the material and processing difficulty of the optical component, the single aperture of the optical system cannot be infinitely enlarged, so the synthetic aperture technology is proposed to replace the single large aperture optical system. Due to the effect of sub-aperture arrangement and light scattering, the imaging of synthetic aperture optical systems will be degraded due to insufficient light area and phase distortion. The traditional imaging restoration algorithm of synthetic aperture optical system is sensitive to noise, relies too much on degenerate model, requires a lot of manual design model, and has poor adaptability. To solve this problem, this paper proposes a multi-scale feature enhancement method for synthetic aperture optical image restoration. U-Net is used to obtain multi-scale feature features, and self-attention in mixed domain is used to improve the feature extraction ability of the network in space and channel. Multi-scale feature fusion module and feature enhancement module are constructed to fuse information between features at different scales. The information interaction mode of the codec layer is optimized, the attention of the whole network to the real structure of the original image is enhanced, and the artifact interference caused by ringing is avoided in the process of restoration. The final experimental results are 1.50%, 7.14% and 5.22% higher than those of advanced deep learning algorithms in the evaluation indexes of peak signal-to-noise ratio, structural similarity and perceived similarity, respectively. In addition, the method presented in this paper has a good restoration effect on the degraded images of different degrees of synthetic aperture, and can effectively restore the degraded images and the images with abnormal light, so as to solve the problem of imaging degradation of synthetic aperture optical system. The feasibility of deep learning method in synthetic aperture optical image restoration is proved.

RestoreNet-Plus: Image restoration via deep learning in optical synthetic aperture imaging system

RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Deep Learning Based Image Restoration Method of Optical Synthetic Aperture Imaging System

Synthetic aperture optical image restoration based on multi-scale feature enhancement

Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network

Image restoration for optical synthetic aperture system via patched maximum-minimum intensity prior and unsupervised DenoiseNet

Fast non-iterative blind restoration of hyperspectral images with PSFs

Image restoration for real-world under-display imaging

Ground-to-air Aircraft Infrared Image Deblurring Based on Imaging Degradation Simulation

Deep Denoiser Prior Based Deep Analytic Network for Lensless Image Restoration.

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Image restoration for optical synthetic aperture system via variational physics-informed network

Single-shot image restoration via a model-enhanced network with unpaired supervision in an optical sparse aperture system

A Method for Remote Sensing Image Restoration Based on the System Degradation Model

Image Restoration of Optical Sparse Aperture Systems Based on a Dual Target Network

Image Restoration Via Improved Wiener Filter Applied to Optical Sparse Aperture Systems

A Progressive Image Restoration Network for High-order Degradation Imaging in Remote Sensing

Near-filed SAR Image Restoration with Deep Learning Inverse Technique: A Preliminary Study

Denoising Prior Driven Deep Neural Network for Image Restoration

A Two-Stage Network for Zero-Shot Low-Illumination Image Restoration