Abstract:Bounding boxes have been widely implemented into aerial object detection for its simplicity. They perform instance-level location with the coordinates and orientation for each target. But the defects such as coarse edge information impede semantic interpretation in earth observation. Besides, in terms of the aerial imaging instruments, it's essential to recognize the exterior appearance and contour of the objects. In this paper, we propose a novel aerial instance segmentation method termed adaptive RoI extraction network (ARE-Net) which bridges the gap of accurately delineating instances under the complex back-ground of aerial images. To exert instance segmentation under the proprietary property, e.g., complex background, densely distributed instances, of aerial images, RoIs are pooled from multi-level feature maps and integral region proposals. On this basis, global attention RoI extractor (GA-RoIE) and perceptual RoI extractor (PRoIE) are respectively introduced for detection branch and mask branch to perform adaptive RoI extraction for aerial images. Meanwhile, to reconcile the probability distribution regional distribution of pixel-wise prediction in aerial images, we present the Adaptive Compound loss function to improve the integrating degree of the predicted binary mask to ground truth mask. Additionally, we adopt RegNetx with Deformable Convolution to optimize ARE-Net, and name it as R-ARE-Net. Despite implementing pixel-wise prediction, comprehensive experiments on iSAID and NWPU VHR-10 instance segmentation dataset still have verified the effectiveness and efficiency of ARE-Net and R-ARE-Net. Experimental results indicate that our proposed methods receive the highest AP value (38.0% AP on iSAID and 64.2% AP on NWPU VHR-10 instance segmentation dataset) and lowest FLOPs and Parameters consumption (~46% reduced FLOPs and 61.5% reduced Parameters than SCNet) among the mainstream methods. Besides, the false alarms, missin- segmentations, poorly predicted masks, and under-segmentations that appeared in the mainstream methods can be avoided to some extend for R-ARE-Net.

Accurate Oriented Instance Segmentation in Aerial Images

A Simultaneous Object Detection and Component Segmentation Approach Based on Mask R-CNN

Oriented RepPoints for Aerial Object Detection

A Lightweight Adaptive RoI Extraction Network for Precise Aerial Image Instance Segmentation

Deep Level Set for Box-supervised Instance Segmentation in Aerial Images

CPISNet: Delving into Consistent Proposals of Instance Segmentation Network for High-Resolution Aerial Images

Efficient Hybrid Supervision for Instance Segmentation in Aerial Images

Segmentation Based Rotated Bounding Boxes Prediction and Image Synthesizing for Object Detection of High Resolution Aerial Images

Oriented R-CNN and Beyond

Rotated YOLOv4 with Attention-wise Object Detectors in Aerial Images

RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features

Reversible Recursive Instance-Level Object Segmentation

Supervised Edge Attention Network for Accurate Image Instance Segmentation

Object Detection and Instance Segmentation in Remote Sensing Imagery Based on Precise Mask R-CNN

DB-BlendMask: Decomposed Attention and Balanced BlendMask for Instance Segmentation of High-Resolution Remote Sensing Images

Orientation-First Strategy With Angle Attention Module for Rotated Object Detection in Remote Sensing Images

Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representation

MRDet: A Multi-Head Network for Accurate Oriented Object Detection in Aerial Images

iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images