Abstract:With the wide application of high resolution imaging technology in terrain mapping, astronomical observation and military reconnaissance, the imaging resolution of optical system is more and more demanding. According to the diffraction limit and Rayleigh criterion, the imaging resolution of the optical system is proportional to the size of the aperture of the system, but affected by the material and processing difficulty of the optical component, the single aperture of the optical system cannot be infinitely enlarged, so the synthetic aperture technology is proposed to replace the single large aperture optical system. Due to the effect of sub-aperture arrangement and light scattering, the imaging of synthetic aperture optical systems will be degraded due to insufficient light area and phase distortion. The traditional imaging restoration algorithm of synthetic aperture optical system is sensitive to noise, relies too much on degenerate model, requires a lot of manual design model, and has poor adaptability. To solve this problem, this paper proposes a multi-scale feature enhancement method for synthetic aperture optical image restoration. U-Net is used to obtain multi-scale feature features, and self-attention in mixed domain is used to improve the feature extraction ability of the network in space and channel. Multi-scale feature fusion module and feature enhancement module are constructed to fuse information between features at different scales. The information interaction mode of the codec layer is optimized, the attention of the whole network to the real structure of the original image is enhanced, and the artifact interference caused by ringing is avoided in the process of restoration. The final experimental results are 1.50%, 7.14% and 5.22% higher than those of advanced deep learning algorithms in the evaluation indexes of peak signal-to-noise ratio, structural similarity and perceived similarity, respectively. In addition, the method presented in this paper has a good restoration effect on the degraded images of different degrees of synthetic aperture, and can effectively restore the degraded images and the images with abnormal light, so as to solve the problem of imaging degradation of synthetic aperture optical system. The feasibility of deep learning method in synthetic aperture optical image restoration is proved.

Deep Learning Based Image Restoration Method of Optical Synthetic Aperture Imaging System

RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Image restoration for real-world under-display imaging

Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network

RestoreNet-Plus: Image restoration via deep learning in optical synthetic aperture imaging system

Image Restoration Via Improved Wiener Filter Applied to Optical Sparse Aperture Systems

Fast non-iterative blind restoration of hyperspectral images with PSFs

Synthetic aperture optical image restoration based on multi-scale feature enhancement

Blind Deconvolution Using an Improved L0 Sparse Representation

Deep Denoiser Prior Based Deep Analytic Network for Lensless Image Restoration.

Deep Learning CT Image Restoration using System Blur Models

Image Restoration Based on Deep Convolutional Network in Wavefront Coding Imaging System.

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

A Method for Remote Sensing Image Restoration Based on the System Degradation Model

Restoration of blurred optical image

A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems

Image restoration for optical synthetic aperture system via patched maximum-minimum intensity prior and unsupervised DenoiseNet

Single-shot image restoration via a model-enhanced network with unpaired supervision in an optical sparse aperture system

Image Restoration of 4f Optical System Based on Neural Network

A Deep Convolutional Encoder–Decoder–Restorer Architecture for Image Deblurring