Abstract:Recent approaches in remote sensing have increasingly focused on multimodal data, driven by the growing availability of diverse earth observation datasets. Integrating complementary information from different modalities has shown substantial potential in enhancing semantic understanding. However, existing global multimodal datasets often lack the inclusion of Synthetic Aperture Radar (SAR) data, which excels at capturing texture and structural details. SAR, as a complementary perspective to other modalities, facilitates the utilization of spatial information for global land use and land cover (LULC). To address this gap, we introduce the Dynamic World+ dataset, expanding the current authoritative multispectral dataset, Dynamic World, with aligned SAR data. Additionally, to facilitate the combination of multispectral and SAR data, we propose a lightweight transformer architecture termed SpecSAR-Former. It incorporates two innovative modules, Dual Modal Enhancement Module (DMEM) and Mutual Modal Aggregation Module (MMAM), designed to exploit cross-information between the two modalities in a split-fusion manner. These modules enhance the model's ability to integrate spectral and spatial information, thereby improving the overall performance of global LULC semantic segmentation. Furthermore, we adopt an imbalanced parameter allocation strategy that assigns parameters to different modalities based on their importance and information density. Extensive experiments demonstrate that our network outperforms existing transformer and CNN-based models, achieving a mean Intersection over Union (mIoU) of 59.58%, an Overall Accuracy (OA) of 79.48%, and an F1 Score of 71.68% with only 26.70M parameters. The code will be available at <a class="link-external link-https" href="https://github.com/Reagan1311/LULC_segmentation" rel="external noopener nofollow">this https URL</a>.

MPT-SFANet: Multi-Order Pooling Transformer-Based Semantic Feature Aggregation Network for SAR Image Classification

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

MFFnet: Multimodal Feature Fusion Network for Synthetic Aperture Radar and Optical Image Land Cover Classification

High-Resolution SAR Image Classification Using Multi-Scale Deep Feature Fusion and Covariance Pooling Manifold Network

PSFNet: Efficient Detection of SAR Image Based on Petty-Specialized Feature Aggregation

SpecSAR-Former: A Lightweight Transformer-based Network for Global LULC Mapping Using Integrated Sentinel-1 and Sentinel-2

Synthetic aperture radar remote sensing scene classification based on fuzzy co-occurrence networks

SPT-UNet: A Superpixel-Level Feature Fusion Network for Water Extraction from SAR Imagery

PPMamba: A Pyramid Pooling Local Auxiliary SSM-Based Model for Remote Sensing Image Semantic Segmentation

FCPFNet: Feature Complementation Network with Pyramid Fusion for Semantic Segmentation

SFMRNet: Specific Feature Fusion and Multibranch Feature Refinement Network for Land Use Classification

Convolutional Feature Aggregation Network With Self-Supervised Learning and Decision Fusion for SAR Target Recognition

A multimodal hyper-fusion transformer for remote sensing image classification

Synthetic Aperture Radar Scene Classification Using Multiview Cross Correlation Attention Network

Feature Aggregation Network for Building Extraction from High-resolution Remote Sensing Images

Polarimetric SAR Image Classification Based on Hierarchical Scattering-Spatial Interaction Transformer

OPT-SAR-MS2Net: A Multi-Source Multi-Scale Siamese Network for Land Object Classification Using Remote Sensing Images

SCTANet: A Spatial Attention-Guided CNN-Transformer Aggregation Network for Deep Face Image Super-Resolution

Multi-Scale Convolutional Neural Network for SAR Image Semantic Segmentation

Cross-Modality Features Fusion for Synthetic Aperture Radar Image Segmentation

Attention feature fusion awareness network for vehicle target detection in SAR images