Abstract:The task of instance segmentation in remote sensing images, aiming at performing per-pixel labeling of objects at instance level, is of great importance for various civil applications. Despite previous successes, most existing instance segmentation methods designed for natural images encounter sharp performance degradations when they are directly applied to top-view remote sensing images. Through careful analysis, we observe that the challenges mainly come from the lack of discriminative object features due to severe scale variations, low contrasts, and clustered distributions. In order to address these problems, a novel context aggregation network (CATNet) is proposed to improve the feature extraction process. The proposed model exploits three lightweight plug-and-play modules, namely dense feature pyramid network (DenseFPN), spatial context pyramid (SCP), and hierarchical region of interest extractor (HRoIE), to aggregate global visual context at feature, spatial, and instance domains, respectively. DenseFPN is a multi-scale feature propagation module that establishes more flexible information flows by adopting inter-level residual connections, cross-level dense connections, and feature re-weighting strategy. Leveraging the attention mechanism, SCP further augments the features by aggregating global spatial context into local regions. For each instance, HRoIE adaptively generates RoI features for different downstream tasks. Extensive evaluations of the proposed scheme on iSAID, DIOR, NWPU VHR-10, and HRSID datasets demonstrate that the proposed approach outperforms state-of-the-arts under similar computational costs. Source code and pre-trained models are available at <a class="link-external link-https" href="https://github.com/yeliudev/CATNet" rel="external noopener nofollow">this https URL</a>.

Aggregating Region Context Information for Semantic Segmentation

Pyramidal Region Context Module for Semantic Segmentation

Neuron-level Selective Context Aggregation for Scene Segmentation

OCNet: Object Context for Semantic Segmentation

OCNet: Object Context Network for Scene Parsing

Attention-based Dual Context Aggregation for Image Semantic Segmentation

ISNet - Integrate Image-Level and Semantic-Level Context for Semantic Segmentation.

Mining Contextual Information Beyond Image for Semantic Segmentation

Cross Aggregation Network for Semantic Segmentation

HCNet: Hierarchical Context Network for Semantic Segmentation

Semantic Segmentation Based on Aggregated Features and Contextual Information

Attention-guided chained context aggregation for semantic segmentation

Adaptive Pyramid Context Network for Semantic Segmentation

Multi-Scale Feature Aggregation by Cross-Scale Pixel-to-Region Relation Operation for Semantic Segmentation

Encouraging the Mutual Interact Between Dataset-Level and Image-Level Context for Semantic Segmentation of Remote Sensing Image

MLCRNet: Multi-Level Context Refinement for Semantic Segmentation in Aerial Images

Learning to Aggregate Multi-Scale Context for Instance Segmentation in Remote Sensing Images

Real-time Semantic Segmentation with Context Aggregation Network

Cascading Context Enhancement Network for RGB-D Semantic Segmentation

Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.

DCANet: Dense Context-Aware Network for Semantic Segmentation