Abstract:The task of instance segmentation in remote sensing images, aiming at performing per-pixel labeling of objects at instance level, is of great importance for various civil applications. Despite previous successes, most existing instance segmentation methods designed for natural images encounter sharp performance degradations when they are directly applied to top-view remote sensing images. Through careful analysis, we observe that the challenges mainly come from the lack of discriminative object features due to severe scale variations, low contrasts, and clustered distributions. In order to address these problems, a novel context aggregation network (CATNet) is proposed to improve the feature extraction process. The proposed model exploits three lightweight plug-and-play modules, namely dense feature pyramid network (DenseFPN), spatial context pyramid (SCP), and hierarchical region of interest extractor (HRoIE), to aggregate global visual context at feature, spatial, and instance domains, respectively. DenseFPN is a multi-scale feature propagation module that establishes more flexible information flows by adopting inter-level residual connections, cross-level dense connections, and feature re-weighting strategy. Leveraging the attention mechanism, SCP further augments the features by aggregating global spatial context into local regions. For each instance, HRoIE adaptively generates RoI features for different downstream tasks. Extensive evaluations of the proposed scheme on iSAID, DIOR, NWPU VHR-10, and HRSID datasets demonstrate that the proposed approach outperforms state-of-the-arts under similar computational costs. Source code and pre-trained models are available at <a class="link-external link-https" href="https://github.com/yeliudev/CATNet" rel="external noopener nofollow">this https URL</a>.

Muti-Scale Context-Aware Network for Cross-Domain Unsupervised Remote Sensing Image Semantic Segmentation

Semantic Segmentation of Remote Sensing Image Based on Contextual U-Net

Hybridizing Cross-Level Contextual and Attentive Representations for Remote Sensing Imagery Semantic Segmentation

Context Aggregation Network for Remote Sensing Image Semantic Segmentation

Context Union Edge Network for Semantic Segmentation of Small-Scale Objects in Very High Resolution Remote Sensing Images

Learning to Aggregate Multi-Scale Context for Instance Segmentation in Remote Sensing Images

Semantic Context-Aware Network for Multiscale Object Detection in Remote Sensing Images

Context Enhancing Representation for Semantic Segmentation in Remote Sensing Images.

Remote Sensing Image Semantic Segmentation Network Based on Multi-Scale Feature Enhancement Fusion

Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.

High-Resolution Remote Sensing Image Semantic Segmentation via Multiscale Context and Linear Self-Attention

Encouraging the Mutual Interact Between Dataset-Level and Image-Level Context for Semantic Segmentation of Remote Sensing Image

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Context-Driven Feature-Focusing Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Multi-source collaborative enhanced for remote sensing images semantic segmentation

Multi-scale Spatial Aggregation Network for Remote Sensing Image Segmentation

Unbalanced Class Learning Network With Scale-Adaptive Perception for Complicated Scene in Remote Sensing Images Segmentation

Multiscale Global Context Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images

Integrating Detailed Features and Global Contexts for Semantic Segmentation in Ultra-High-Resolution Remote Sensing Images

A semantic segmentation method for remote sensing images based on multiple contextual feature extraction