Abstract:Synthetic aperture radar (SAR) has the advantage of all-weather observation, but its imaging principle based on the backscattering of electromagnetic waves makes its information less interpretable. One feasible approach is to convert SAR images into optical images, which not only improves the interpretability of SAR images but also fills the gaps in information captured by optical sensors due to weather and light limitations. Since conditional generative adversarial network (cGAN) has the powerful ability to generate images, many studies have started to apply it to image translation tasks. For SAR-to-optical translation, some specialized cGAN models have been proposed, but most of them struggle to process SAR images with widely varying styles, often generating images with poor quality. To this end, we propose a hybrid cGAN that combines the advantages of convolutional neural network (CNN) and vision transformer (ViT). With the advantage of ViT to capture long-distance feature dependencies, the global features can be extracted and then fused with the local features extracted by CNN to improve the representation capabilities of our generator. Moreover, we expand the receptive field of the residual blocks in CNN by hierarchical convolution. Perceptual loss and classification loss are added for training to further improve the fidelity of the generated images. Finally, we introduce the multiscale strategy into the discriminator to balance its learning ability with that of the generator. Both visual and quantitative experiments are conducted with other state-of-the-art methods. The results show that our method not only achieves the optimal results in all the evaluation metrics but also generates images that are more consistent with the human visual system. In addition, the potential of our method to process multitype SAR images with significant style differences is also experimentally demonstrated.

ISAR Target Recognition Using Pix2pix Network Derived from Cgan

A-CGAN based transformation from ISAR to optical image

ISAR Images Generation Via Generative Adversarial Networks

Improved Cgan for SAR-to-Optical Image Translation

A SAR-to-Optical Image Translation Method Based on PIX2PIX.

A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)

Few-shot ISAR Target Recognition Method Based on Improved Prototype Networks

Achieving High-Accuracy Target Recognition Using Few ISAR Images via Multi-Prototype Network with Attention Mechanism

Hybrid Cgan: Coupling Global and Local Features for SAR-to-Optical Image Translation

Integrated GANs: Semi-Supervised SAR Target Recognition

From Coarse to Fine: ISAR Object View Interpolation via Flow Estimation and GAN

An ISAR Image Component Recognition Method Based on Semantic Segmentation and Mask Matching

Recognition of Space Target Based on GNN under the Condition of Small Samples for ISAR Image

SAR-to-Optical Image Translating Through Generate-Validate Adversarial Networks

Land-Sea Target Detection and Recognition in SAR Image Based on Non-Local Channel Attention Network.

CycleGAN-Based SAR-Optical Image Fusion for Target Recognition

SAR Image Generation Method Using DH-GAN for Automatic Target Recognition

Target Recognition in Synthetic Aperture Radar Image Based on PCANet

SAR Target Recogniuion Based on Transfer Learning and Data Augmentation with ISGANs

GNSS-Based Passive Inverse SAR Imaging

Image translation between high-resolution optical and synthetic aperture radar (SAR) data