Abstract:Synthetic aperture radar (SAR) images have been one of the important tools to support earth observations and topographic measurements. It means that SAR images are essentially rich in structures. However, the single spatial relationship is difficult to deal with the heterogeneous structures of the SAR images. In this paper, we propose an adaptive hierarchical multinomial latent model with hybrid kernel function for SAR image semantic segmentation. In the proposed approach, we design a hybrid kernel function combing Gaussian radial basis function (GRBF) and ridgelet kernel function to adaptively describe the spatial relationships between the central pixel and the surrounding pixels. Then, based on the hybrid kernel function, adaptive methods are proposed for semantic segmentation. Specifically, an SAR image is divided into different characteristics subspaces, homogeneous, structural, and aggregated subspaces, by SAR hierarchical semantic model. For the homogeneous subspace, GRBF is used to describe the isotropic spatial relationships. Then, multilayer multinomial latent model with GRBF is used for segmentation to improve the labeling consistency and reduce the wrong segmentation. For the structural subspace, the ridgelet kernel function is used to describe the anisotropic spatial relationships. Then, we adopt the singlelayer multinomial latent model with ridgelet kernel function for segmentation to preserve the details (such as edge, lines, and small objects). For aggregated subspace, bag-of-words model is used to extract the features of the aggregated portions, and then affinity propagation cluster is used for segmentation. Finally, the segmentation results of different subspaces are integrated together to obtain the final segmentation result. Comprehensive experiments on both synthetic and real SAR images demonstrate that the segmentation results by our proposed approach achieve the semantic consistency, labeling consistency, and detail preservation simultaneously.

Contrastive Multiview Coding with Electro-optics for SAR Semantic Segmentation

CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders

Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding

Adaptive Hierarchical Multinomial Latent Model with Hybrid Kernel Function for SAR Image Semantic Segmentation

Differentially Deep Subspace Representation for Unsupervised Change Detection of SAR Images

Contrastive Multiview Coding

Learning SAR-Optical Cross Modal Features for Land Cover Classification

Joint Learning of Semantic Segmentation and Height Estimation for Remote Sensing Image Leveraging Contrastive Learning

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

SAR2EO: A High-resolution Image Translation Framework with Denoising Enhancement

Multi-Source Remote Sensing Pretraining Based on Contrastive Self-Supervised Learning

Multilabel-Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining

SAR Image Segmentation Based on Hierarchical Visual Semantic and Adaptive Neighborhood Multinomial Latent Model

Unsupervised SAR and Optical Image Matching Using Siamese Domain Adaptation

Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining

Remote Sensing Image Coding for Machines on Semantic Segmentation via Contrastive Learning

Differentiable SAR Renderer Embedded Reinforcement Learning for View Angles Inversion in SAR Images

End-to-End SAR Deep Learning Imaging Method Based on Sparse Optimization

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

SAR-NeRF: Neural Radiance Fields for Synthetic Aperture Radar Multi-View Representation

Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks