Abstract:Supervised deep neural networks (DNNs) have proven to be powerful tools for synthetic aperture radar (SAR) image interpretation tasks. However, they present a formidable challenge in acquiring a substantial amount of labeled data. In this article, we investigate the promising technique of contrastive self-supervised learning for SAR image classification. This approach allows us to take advantage of a large number of available unlabeled images to pretrain an SAR image classification model. Our novel contrastive learning framework conducts both instance-level and cluster-level pretext tasks, which not only enforce consistency between the images and their augmented “views” at the instance level but also their representation within clusters. Besides generating different views through random, low-level image transformations, we proposed two new strategies to construct positive sample pairs to improve contrastive SAR image feature learning: middle-level optical assistance and high-level graph searching. The middle-level optical assistance strategy is inspired by the observation that domain experts typically interpret SAR images with the aid of optical images. This insight spurs us to generate intermediate SAR images as positive samples from geographically matched optical data using CycleGAN. Furthermore, we augment the positive samples of the image with their $k$ -nearest neighbor (KNN) counterparts, following the idea that the KNN samples should belong to the same cluster. Extensive experimental results conducted on the SEN12MS land cover classification benchmark dataset demonstrate that our method is competitive with state-of-the-art self-supervised methods for SAR image classification. Even with only a small amount of labeled data for fine-tuning the model, our method rapidly improves classification performance, surpassing models pretrained on natural image datasets.

Self-Supervised Classification of SAR Images with Optical Image Assistance

SAR Image Interpretation Using CNN and Contrastive Learning

Self-Supervised Feature Representation for SAR Image Target Classification Using Contrastive Learning

Multi-Source Remote Sensing Pretraining Based on Contrastive Self-Supervised Learning

Self-Supervised Contrastive Learning on Cross-Augmented Samples for SAR Target Recognition

SAR Image Classification Using Contrastive Learning and Pseudo-Labels with Limited Data

Coarse-to-Fine Contrastive Self-Supervised Feature Learning for Land-Cover Classification in SAR Images With Limited Labeled Data

Simulation-assisted SAR Target Classification Based on Unsupervised Domain Adaptation and Model Interpretability Analysis

Contrastive Learning-Based Dual Dynamic GCN for SAR Image Scene Classification.

Unsupervised Aircraft Detection in SAR Images with Image-Level Domain Adaption from Optical Images

Self-supervised SAR-optical Data Fusion and Land-cover Mapping using Sentinel-1/-2 Images

A Semantic Segmentation Method for SAR Image with Assistance of Self-Supervised Scene Classification

SAR-CDSS: A Semi-Supervised Cross-Domain Object Detection from Optical to SAR Domain

Adversarial Self-Supervised Learning for Robust SAR Target Recognition

A Novel Semi-Supervised Method Based on Active Sample Proposal and Modified Self-Learning for SAR Target Discrimination

Hyperspectral Imagery Classification Based on Contrastive Learning

Unsupervised Deep Representation Learning and Few-Shot Classification of PolSAR Images.

Nearest Neighbor-Based Contrastive Learning for Hyperspectral and LiDAR Data Classification

Scattering Characteristics-guided Self-supervised Learning for Target Classification in SAR Images

Locality Preserving Property Constrained Contrastive Learning for Object Classification in SAR Imagery

Deep Supervised and Contractive Neural Network for Sar Image Classification