Abstract:Synthetic aperture radar (SAR) images have been one of the important tools to support earth observations and topographic measurements. It means that SAR images are essentially rich in structures. However, the single spatial relationship is difficult to deal with the heterogeneous structures of the SAR images. In this paper, we propose an adaptive hierarchical multinomial latent model with hybrid kernel function for SAR image semantic segmentation. In the proposed approach, we design a hybrid kernel function combing Gaussian radial basis function (GRBF) and ridgelet kernel function to adaptively describe the spatial relationships between the central pixel and the surrounding pixels. Then, based on the hybrid kernel function, adaptive methods are proposed for semantic segmentation. Specifically, an SAR image is divided into different characteristics subspaces, homogeneous, structural, and aggregated subspaces, by SAR hierarchical semantic model. For the homogeneous subspace, GRBF is used to describe the isotropic spatial relationships. Then, multilayer multinomial latent model with GRBF is used for segmentation to improve the labeling consistency and reduce the wrong segmentation. For the structural subspace, the ridgelet kernel function is used to describe the anisotropic spatial relationships. Then, we adopt the singlelayer multinomial latent model with ridgelet kernel function for segmentation to preserve the details (such as edge, lines, and small objects). For aggregated subspace, bag-of-words model is used to extract the features of the aggregated portions, and then affinity propagation cluster is used for segmentation. Finally, the segmentation results of different subspaces are integrated together to obtain the final segmentation result. Comprehensive experiments on both synthetic and real SAR images demonstrate that the segmentation results by our proposed approach achieve the semantic consistency, labeling consistency, and detail preservation simultaneously.

Remote Sensing Image Fusion Using Hierarchical Multimodal Probabilistic Latent Semantic Analysis.

Subspace-Based Feature Fusion From Hyperspectral And Multispectral Image For Land Cover Classification

Multi-Modal Fusion Architecture Search for Land Cover Classification Using Heterogeneous Remote Sensing Images.

Multimodal Semantic Consistency-Based Fusion Architecture Search for Land Cover Classification

Adaptive Hierarchical Multinomial Latent Model with Hybrid Kernel Function for SAR Image Semantic Segmentation

Multispectral and SAR Image Fusion Based on Laplacian Pyramid and Sparse Representation

Hyperspectral and multispectral image fusion addressing spectral variability by an augmented linear mixing model

Learning SAR-Optical Cross Modal Features for Land Cover Classification

MIMA: MAPPER-Induced Manifold Alignment for Semi-Supervised Fusion of Optical Image and Polarimetric SAR Data

Deep Multimodal Fusion for Semantic Segmentation of Remote Sensing Earth Observation Data

Multi-Resolution Multi-Modal Sensor Fusion For Remote Sensing Data With Label Uncertainty

FusionMamba: Efficient Remote Sensing Image Fusion with State Space Model

Unsupervised Hyperspectral and Multispectral Images Fusion Based on Nonlinear Variational Probabilistic Generative Model

Multimodal Semantic Collaborative Classification for Hyperspectral Images and LiDAR Data

Sparse Representation and Pca Method for Image Fusion in Remote Sensing

LMFNet: An Efficient Multimodal Fusion Approach for Semantic Segmentation in High-Resolution Remote Sensing

An Effective Multi-model Fusion Method for SAR and Optical Remote Sensing Images

A Decision Fusion Method for Land Cover Classification Using Multi-Sensor Data

Multimodal Sentiment Analysis in Realistic Environments Based on Cross-Modal Hierarchical Fusion Network

Multimodal Hyperspectral Image Classification via Interconnected Fusion

CMSE: Cross-Modal Semantic Enhancement Network for Classification of Hyperspectral and LiDAR Data