Abstract:With the wide application of high resolution imaging technology in terrain mapping, astronomical observation and military reconnaissance, the imaging resolution of optical system is more and more demanding. According to the diffraction limit and Rayleigh criterion, the imaging resolution of the optical system is proportional to the size of the aperture of the system, but affected by the material and processing difficulty of the optical component, the single aperture of the optical system cannot be infinitely enlarged, so the synthetic aperture technology is proposed to replace the single large aperture optical system. Due to the effect of sub-aperture arrangement and light scattering, the imaging of synthetic aperture optical systems will be degraded due to insufficient light area and phase distortion. The traditional imaging restoration algorithm of synthetic aperture optical system is sensitive to noise, relies too much on degenerate model, requires a lot of manual design model, and has poor adaptability. To solve this problem, this paper proposes a multi-scale feature enhancement method for synthetic aperture optical image restoration. U-Net is used to obtain multi-scale feature features, and self-attention in mixed domain is used to improve the feature extraction ability of the network in space and channel. Multi-scale feature fusion module and feature enhancement module are constructed to fuse information between features at different scales. The information interaction mode of the codec layer is optimized, the attention of the whole network to the real structure of the original image is enhanced, and the artifact interference caused by ringing is avoided in the process of restoration. The final experimental results are 1.50%, 7.14% and 5.22% higher than those of advanced deep learning algorithms in the evaluation indexes of peak signal-to-noise ratio, structural similarity and perceived similarity, respectively. In addition, the method presented in this paper has a good restoration effect on the degraded images of different degrees of synthetic aperture, and can effectively restore the degraded images and the images with abnormal light, so as to solve the problem of imaging degradation of synthetic aperture optical system. The feasibility of deep learning method in synthetic aperture optical image restoration is proved.

Data-Driven Variable Synthetic Aperture Imaging Based on Semantic Feedback

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

Semantic Visual Odometry Based on Panoramic Annular Imaging

A Statistical View on Synthetic Aperture Imaging for Occlusion Removal

Computational Imaging for Machine Perception: Transferring Semantic Segmentation beyond Aberrations

Synthetic aperture based on plenoptic cameras for seeing behind occlusion

Synthetic Aperture Based on Plenoptic Camera for Seeing Through Occlusions

A Variable Radius Side Window Direct SLAM Method Based on Semantic Information

Real-Time, Deep Synthetic Aperture Sonar (SAS) Autofocus

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Adaptation in Semantic Segmentation

Multi-source Domain Adaptation for Panoramic Semantic Segmentation

Deep Autofocus for Synthetic Aperture Sonar

A Semantic SLAM System for Catadioptric Panoramic Cameras in Dynamic Environments

Seeing Through Obstructions with Diffractive Cloaking

Target Oriented High Resolution SAR Image Formation via Semantic Information Guided Regularizations

Towards Pragmatic Semantic Image Synthesis for Urban Scenes

Scene-adaptive Coded Apertures Imaging

Semantic Segmentation of Panoramic Images Using a Synthetic Dataset

Synthetic aperture optical image restoration based on multi-scale feature enhancement