Abstract:Semantic segmentation of remote sensing images plays an important role in a wide range of applications including land resource management, biosphere monitoring and urban planning. Although the accuracy of semantic segmentation in remote sensing images has been increased significantly by deep convolutional neural networks, several limitations exist in standard models. First, for encoder-decoder architectures such as U-Net, the utilization of multi-scale features causes the underuse of information, where low-level features and high-level features are concatenated directly without any refinement. Second, long-range dependencies of feature maps are insufficiently explored, resulting in sub-optimal feature representations associated with each semantic class. Third, even though the dot-product attention mechanism has been introduced and utilized in semantic segmentation to model long-range dependencies, the large time and space demands of attention impede the actual usage of attention in application scenarios with large-scale input. This paper proposed a Multi-Attention-Network (MANet) to address these issues by extracting contextual dependencies through multiple efficient attention modules. A novel attention mechanism of kernel attention with linear complexity is proposed to alleviate the large computational demand in attention. Based on kernel attention and channel attention, we integrate local feature maps extracted by ResNeXt-101 with their corresponding global dependencies and reweight interdependent channel maps adaptively. Numerical experiments on three large-scale fine resolution remote sensing images captured by different satellite sensors demonstrate the superior performance of the proposed MANet, outperforming the DeepLab V3+, PSPNet, FastFCN, DANet, OCRNet, and other benchmark approaches.

Multilevel Attention for Referring Expression Comprehension

Multi-level expression guided attention network for referring expression comprehension

MAttNet: Modular Attention Network for Referring Expression Comprehension

Multi-Task Collaborative Network for Joint Referring Expression Comprehension and Segmentation

A Multi-Scale Language Embedding Network for Proposal-Free Referring Expression Comprehension.

Self-paced Multi-grained Cross-modal Interaction Modeling for Referring Expression Comprehension

Dynamic Graph Attention for Referring Expression Comprehension

Multivariate Attention Network For Image Captioning

RefCrowd: Grounding the Target in Crowd with Referring Expressions

Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images

Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Images

Parallel Attention: A Unified Framework for Visual Object Discovery Through Dialogs and Queries.

Neighbourhood Watch: Referring Expression Comprehension Via Language-Guided Graph Attention Networks

Multi-View Attention Network for Remote Sensing Image Captioning

Multi-Modal Mutual Attention and Iterative Interaction for Referring Image Segmentation

Bi-Directional Relationship Inferring Network For Referring Image Segmentation

Multi-Grained Attention Network with Mutual Exclusion for Composed Query-Based Image Retrieval

MCCE-REC: MLLM-driven Cross-modal Contrastive Entropy Model for Zero-shot Referring Expression Comprehension

Key-Word-Aware Network for Referring Expression Image Segmentation