Abstract:Semantic segmentation is important for the understanding of subdecimeter aerial images. In recent years, deep convolutional neural networks (DCNNs) have been used widely for semantic segmentation in the field of remote sensing. However, because of the highly complex subdecimeter resolution of aerial images, inseparability often occurs among some geographic entities of interest in the spectral domain. In addition, the semantic segmentation methods based on DCNNs mostly obtain context information using extra information within the added receptive field. However, the context information obtained this way is not explicit. We propose a novel class-constraint coarse-to-fine attentional (CCA) deep network, which enables the formation of class information constraints to obtain explicit long-range context information. Further, the performance of subdecimeter aerial image semantic segmentation can be improved, particularly for fine-structured geographic entities. Based on coarse-to-fine technology, we obtained a coarse segmentation result and constructed an image class feature library. We propose the use of the attention mechanism to obtain strong class-constrained features. Consequently, pixels of different geographic entities can adaptively match the corresponding categories in the class feature library. Additionally, we employed a novel loss function, CCA-loss to realize end-to-end training. The experimental results obtained using two popular open benchmarks, International Society for Photogrammetry and Remote Sensing (ISPRS) 2-D semantic labeling Vaihingen data set and Institute of Electrical and Electronics Engineers (IEEE) Geoscience and Remote Sensing Society (GRSS) Data Fusion Contest Zeebrugge data set, validated the effectiveness and superiority of our proposed model. The proposed method achieved state-of-the-art performance on the IEEE GRSS Data Fusion Contest Zeebrugge data set.

Segmentation of Aerial Image with Multi-scale Feature and Attention Model

An Aerial Image Segmentation Approach Based on Enhanced Multi-Scale Convolutional Neural Network

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

High-Resolution Aerial Images Semantic Segmentation Using Deep Fully Convolutional Network with Channel Attention Mechanism

Semantic Segmentation of Aerial Image Using Fully Convolutional Network.

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Attention Residual U-Net for Building Segmentation in Aerial Images.

Semantic Segmentation for High-Resolution Aerial Imagery Using Multi-Skip Network and Markov Random Fields

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

MA-DBFAN: Multiple-Attention-based Dual Branch Feature Aggregation Network for Aerial Image Semantic Segmentation

CCANet: Class-Constraint Coarse-to-Fine Attentional Deep Network for Subdecimeter Aerial Image Semantic Segmentation.

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

Aerial Image Semantic Segmentation Using Spatial and Channel Attention

BIDIRECTIONAL MULTI-SCALE ATTENTION NETWORKS FOR SEMANTIC SEGMENTATION OF OBLIQUE UAV IMAGERY

UAVSeg: Dual-Encoder Cross-Scale Attention Network for UAV Images Semantic Segmentation

Deep Attention And Multi-Scale Networks For Accurate Remote Sensing Image Segmentation

Attention-Guided Label Refinement Network For Semantic Segmentation Of Very High Resolution Aerial Orthoimages

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images

Dual Path Attention Net For Remote Sensing Semantic Image Segmentation

Semantic Segmentation of Aerial Imagery Via Split-Attention Networks with Disentangled Nonlocal and Edge Supervision