Abstract:Bounding boxes have been widely implemented into aerial object detection for its simplicity. They perform instance-level location with the coordinates and orientation for each target. But the defects such as coarse edge information impede semantic interpretation in earth observation. Besides, in terms of the aerial imaging instruments, it's essential to recognize the exterior appearance and contour of the objects. In this paper, we propose a novel aerial instance segmentation method termed adaptive RoI extraction network (ARE-Net) which bridges the gap of accurately delineating instances under the complex back-ground of aerial images. To exert instance segmentation under the proprietary property, e.g., complex background, densely distributed instances, of aerial images, RoIs are pooled from multi-level feature maps and integral region proposals. On this basis, global attention RoI extractor (GA-RoIE) and perceptual RoI extractor (PRoIE) are respectively introduced for detection branch and mask branch to perform adaptive RoI extraction for aerial images. Meanwhile, to reconcile the probability distribution regional distribution of pixel-wise prediction in aerial images, we present the Adaptive Compound loss function to improve the integrating degree of the predicted binary mask to ground truth mask. Additionally, we adopt RegNetx with Deformable Convolution to optimize ARE-Net, and name it as R-ARE-Net. Despite implementing pixel-wise prediction, comprehensive experiments on iSAID and NWPU VHR-10 instance segmentation dataset still have verified the effectiveness and efficiency of ARE-Net and R-ARE-Net. Experimental results indicate that our proposed methods receive the highest AP value (38.0% AP on iSAID and 64.2% AP on NWPU VHR-10 instance segmentation dataset) and lowest FLOPs and Parameters consumption (~46% reduced FLOPs and 61.5% reduced Parameters than SCNet) among the mainstream methods. Besides, the false alarms, missin- segmentations, poorly predicted masks, and under-segmentations that appeared in the mainstream methods can be avoided to some extend for R-ARE-Net.

Reversible Recursive Instance-Level Object Segmentation

Proposal-Free Network for Instance-Level Object Segmentation

Learning to Segment Object Proposals via Recursive Neural Networks.

Multi-Instance Object Segmentation With Occlusion Handling

Self-Balanced R-CNN for Instance Segmentation

Learning to Segment Object Candidates Via Recursive Neural Networks

2nd Place Solution to Instance Segmentation of IJCAI 3D AI Challenge 2020

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

SPRNet: Single-Pixel Reconstruction for One-Stage Instance Segmentation

Mask SSD: an Effective Single-Stage Approach to Object Instance Segmentation

Accurate Oriented Instance Segmentation in Aerial Images

A Lightweight Adaptive RoI Extraction Network for Precise Aerial Image Instance Segmentation

DOBNET - Dynamic Object Boundary-Refinement Network for Real-Time Instance Segmentation.

Discriminative Features Reconstruction Network For Semantic Segmentation

Learning from Box Annotations for Referring Image Segmentation.

Pixel-wise Reclassification with Prototypes for Enhancing Weakly Supervised Semantic Segmentation

BoxInst: High-Performance Instance Segmentation with Box Annotations.

Region Proposal Rectification Towards Robust Instance Segmentation of Biological Images

Weakly supervised segmentation via instance-aware propagation

CPISNet: Delving into Consistent Proposals of Instance Segmentation Network for High-Resolution Aerial Images

Boundary-Aware Instance Segmentation