Abstract:The joint of multi-source remote sensing (RS) data for land cover classification has become a popular research topic. Although studies have shown that the fusion of multi-source data can improve the accuracy of classification, the current limitation lies in the inadequate exploitation of information, resulting in spectral confusion categories overlapping, and varying visual differences within the same category. To address these problems, this paper proposes a multi-scale spectral-spatial attention residual fusion network (MSSARFNet) that aims to enhance the classification performance of multi-source RS data through effective spectral-spatial feature extraction and fusion. Specifically, three modules are designed: the multi-scale spectral attention residual module (MSpeARM), the multi-scale spatial attention residual module (MSpaARM) and multi-scale convolution fusion (MCF) module. Firstly, we divide the channels of the features into multiple paths and apply spectral-spatial attention mechanisms on each path. To further enhance connectivity, convolutional operation is utilized to establish connections between different paths, thus forming MSpeARM and MSpaARM. The MSpeARM suppresses redundant features and enhances effective features along the channel dimension to better differentiate spectral-confused categories. The MSpaARM highlights that different visual patterns of objects in the same category can mutually reinforce each other by weighting all positional features, regardless of their spatial differences. Secondly, to fuse these two sets of features, the MCF module is designed to learn multi-level semantic features and enhance fusion at a granular level. Experimental evaluations on three RS datasets demonstrate that the proposed method achieves excellent classification performance, indicating the effectiveness of MSSARFNet. The source code of the proposed method will be available at https://github.com/wangxu0210/MSSARFNet .

Multi-Stage Fusion and Multi-Source Attention Network for Multi-Modal Remote Sensing Image Segmentation.

Multi-source collaborative enhanced for remote sensing images semantic segmentation

Semantic Segmentation of Remote-Sensing Images Based on Multiscale Feature Fusion and Attention Refinement

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Multi-View Feature Fusion and Rich Information Refinement Network for Semantic Segmentation of Remote Sensing Images

Semantic Segmentation Of Remote Sensing Images Based On Multi-Model Fusion

Dual-Path Multi-Level Feature Fusion Network for Semantic Segmentation of Remote Sensing Image

MFSA-Net: Semantic Segmentation with Camera-LiDAR Cross-Attention Fusion Based on Fast Neighbor Feature Aggregation

MFCSNet: Multi-Scale Deep Features Fusion and Cost-Sensitive Loss Function Based Segmentation Network for Remote Sensing Images

Multi-scale attention fusion network for semantic segmentation of remote sensing images

A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data

Multi-scale Spatial Aggregation Network for Remote Sensing Image Segmentation

Remote Sensing Image Semantic Segmentation Network Based on Multi-Scale Feature Enhancement Fusion

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Dual Path Attention Net For Remote Sensing Semantic Image Segmentation

A Transformer-based Multi-Modal Fusion Network for Semantic Segmentation of High-Resolution Remote Sensing Imagery

A Multi-Attention UNet for Semantic Segmentation in Remote Sensing Images

FDGSNet: A Multi-modal Gated Segmentation Network for Remote Sensing Image Based on Frequency Decomposition

Multi-Scale Spectral-Spatial Attention Residual Fusion Network for Multi-Source Remote Sensing Data Classification

Multi-Scale Adaptive Feature Fusion Network For Semantic Segmentation In Remote Sensing Images

Deep Multimodal Fusion Network for Semantic Segmentation Using Remote Sensing Image and LiDAR Data