Abstract:Semantic segmentation of remote sensing (RS) images is vital in various practical applications, including urban construction planning, natural disaster monitoring, and land resources investigation. However, RS images are captured by airplanes or satellites at high altitudes and long distances, resulting in ground objects of the same category being scattered in various corners of the image. Moreover, objects of different sizes appear simultaneously in RS images. For example, some objects occupy a large area in urban scenes, while others only have small regions. Technically, the above two universal situations pose significant challenges to the segmentation with a high quality for RS images. Based on these observations, this paper proposes a Mask2Former with an improved query (IQ2Former) for this task. The fundamental motivation behind the IQ2Former is to enhance the capability of the query of Mask2Former by exploiting the characteristics of RS images well. First, we propose the Query Scenario Module (QSM), which aims to learn and group the queries from feature maps, allowing the selection of distinct scenarios such as the urban and rural areas, building clusters, and parking lots. Second, we design the query position module (QPM), which is developed to assign the image position information to each query without increasing the number of parameters, thereby enhancing the model's sensitivity to small targets in complex scenarios. Finally, we propose the query attention module (QAM), which is constructed to leverage the characteristics of query attention to extract valuable features from the preceding queries. Being positioned between the duplicated transformer decoder layers, QAM ensures the comprehensive utilization of the supervisory information and the exploitation of those fine-grained details. Architecturally, the QSM, QPM, and QAM as well as an end-to-end model are assembled to achieve high-quality semantic segmentation. In comparison to the classical or state-of-the-art models (FCN, PSPNet, DeepLabV3+, OCRNet, UPerNet, MaskFormer, Mask2Former), IQ2Former has demonstrated exceptional performance across three publicly challenging remote-sensing image datasets, 83.59 mIoU on the Vaihingen dataset, 87.89 mIoU on Potsdam dataset, and 56.31 mIoU on LoveDA dataset. Additionally, overall accuracy, ablation experiment, and visualization segmentation results all indicate IQ2Former validity.

Multi-query and Multi-Level Enhanced Network for Semantic Segmentation

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Mask2Former with Improved Query for Semantic Segmentation in Remote-Sensing Images

Multi-Path Spatial Detail-Aware Network for Semantic Segmentation

Multilevel feature fusion dilated convolutional network for semantic segmentation

Multi-module Spatial Semantic Network for Semantic Segmentation

Semi-Supervised Adversarial Semantic Segmentation Network Using Transformer and Multiscale Convolution for High-Resolution Remote Sensing Imagery

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

QTSeg: A Query Token-Based Architecture for Efficient 2D Medical Image Segmentation

SeMask-Mask2Former: A Semantic Segmentation Model for High Resolution Remote Sensing Images

Dynamic Focus-aware Positional Queries for Semantic Segmentation

Multi-stage Context Refinement Network for Semantic Segmentation

Pyramid Fusion Transformer for Semantic Segmentation

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

SCFI-ESeg: Enhancing Semantic Segmentation with Spatial and Content Feature Integration

Multi-Scale Spatial Location Preference For Semantic Segmentation

Multi‐stream Densely Connected Network for Semantic Segmentation

Self-Support Matching Networks with Multiscale Attention for Few-shot Semantic Segmentation

A Stage-Adaptive Selective Network with Position Awareness for Semantic Segmentation of LULC Remote Sensing Images

Semantic Segmentation Network with Multi-Path Structure, Attention Reweighting and Multi-Scale Encoding

Multi-Stage Fusion and Multi-Source Attention Network for Multi-Modal Remote Sensing Image Segmentation.