Abstract:With the wide application of high resolution imaging technology in terrain mapping, astronomical observation and military reconnaissance, the imaging resolution of optical system is more and more demanding. According to the diffraction limit and Rayleigh criterion, the imaging resolution of the optical system is proportional to the size of the aperture of the system, but affected by the material and processing difficulty of the optical component, the single aperture of the optical system cannot be infinitely enlarged, so the synthetic aperture technology is proposed to replace the single large aperture optical system. Due to the effect of sub-aperture arrangement and light scattering, the imaging of synthetic aperture optical systems will be degraded due to insufficient light area and phase distortion. The traditional imaging restoration algorithm of synthetic aperture optical system is sensitive to noise, relies too much on degenerate model, requires a lot of manual design model, and has poor adaptability. To solve this problem, this paper proposes a multi-scale feature enhancement method for synthetic aperture optical image restoration. U-Net is used to obtain multi-scale feature features, and self-attention in mixed domain is used to improve the feature extraction ability of the network in space and channel. Multi-scale feature fusion module and feature enhancement module are constructed to fuse information between features at different scales. The information interaction mode of the codec layer is optimized, the attention of the whole network to the real structure of the original image is enhanced, and the artifact interference caused by ringing is avoided in the process of restoration. The final experimental results are 1.50%, 7.14% and 5.22% higher than those of advanced deep learning algorithms in the evaluation indexes of peak signal-to-noise ratio, structural similarity and perceived similarity, respectively. In addition, the method presented in this paper has a good restoration effect on the degraded images of different degrees of synthetic aperture, and can effectively restore the degraded images and the images with abnormal light, so as to solve the problem of imaging degradation of synthetic aperture optical system. The feasibility of deep learning method in synthetic aperture optical image restoration is proved.

RestoreNet: a deep learning framework for image restoration in optical synthetic aperture imaging system

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Image restoration for real-world under-display imaging

Fast non-iterative blind restoration of hyperspectral images with PSFs

Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network

Ground-to-air Aircraft Infrared Image Deblurring Based on Imaging Degradation Simulation

Blind restoration of compressed degraded image based on block effect suppression

Synthetic aperture optical image restoration based on multi-scale feature enhancement

Deep Denoiser Prior Based Deep Analytic Network for Lensless Image Restoration.

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Single-shot image restoration via a model-enhanced network with unpaired supervision in an optical sparse aperture system

Deep Learning CT Image Restoration using System Blur Models

Image Restoration Via Improved Wiener Filter Applied to Optical Sparse Aperture Systems

A Deep Convolutional Encoder–Decoder–Restorer Architecture for Image Deblurring

Deep Learning CT Image Restoration using System Blur and Noise Models

A New Deep Learning Method for Image Deblurring in Optical Microscopic Systems

Reference-Based Multi-Level Features Fusion Deblurring Network for Optical Remote Sensing Images

A Multi-scale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing

Deep Linear Array Pushbroom Image Restoration: A Degradation Pipeline and Jitter-Aware Restoration Network

A Multiscale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing

Image restoration model for microscopic defocused images based on blurring kernel guidance