Abstract:Bounding boxes have been widely implemented into aerial object detection for its simplicity. They perform instance-level location with the coordinates and orientation for each target. But the defects such as coarse edge information impede semantic interpretation in earth observation. Besides, in terms of the aerial imaging instruments, it's essential to recognize the exterior appearance and contour of the objects. In this paper, we propose a novel aerial instance segmentation method termed adaptive RoI extraction network (ARE-Net) which bridges the gap of accurately delineating instances under the complex back-ground of aerial images. To exert instance segmentation under the proprietary property, e.g., complex background, densely distributed instances, of aerial images, RoIs are pooled from multi-level feature maps and integral region proposals. On this basis, global attention RoI extractor (GA-RoIE) and perceptual RoI extractor (PRoIE) are respectively introduced for detection branch and mask branch to perform adaptive RoI extraction for aerial images. Meanwhile, to reconcile the probability distribution regional distribution of pixel-wise prediction in aerial images, we present the Adaptive Compound loss function to improve the integrating degree of the predicted binary mask to ground truth mask. Additionally, we adopt RegNetx with Deformable Convolution to optimize ARE-Net, and name it as R-ARE-Net. Despite implementing pixel-wise prediction, comprehensive experiments on iSAID and NWPU VHR-10 instance segmentation dataset still have verified the effectiveness and efficiency of ARE-Net and R-ARE-Net. Experimental results indicate that our proposed methods receive the highest AP value (38.0% AP on iSAID and 64.2% AP on NWPU VHR-10 instance segmentation dataset) and lowest FLOPs and Parameters consumption (~46% reduced FLOPs and 61.5% reduced Parameters than SCNet) among the mainstream methods. Besides, the false alarms, missin- segmentations, poorly predicted masks, and under-segmentations that appeared in the mainstream methods can be avoided to some extend for R-ARE-Net.

An Improved IRNet for Instance Segmentation Based on Image-level Supervision.

IDRNet: Intervention-Driven Relation Network for Semantic Segmentation

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Irsnet: An Inception-Resnet Feature Reconstruction Model For Building Segmentation

IRNet: an Improved Zero-Shot Retinex Network for Low-Light Image Enhancement

IRNet: Instance Relation Network for Overlapping Cervical Cell Segmentation

IMD-Net: Interpretable multi-scale detection network for infrared dim and small objects

Context-Aware Interaction Network for RGB-T Semantic Segmentation

Regional Interactive Image Segmentation Networks

IIE-SegNet: Deep Semantic Segmentation Network With Enhanced Boundary Based on Image Information Entropy

Nv-Net: Efficient Infrared Image Segmentation with Convolutional Neural Networks in the Low Illumination Environment

R-Net: A Novel Fully Convolutional Network–based Infrared Image Segmentation Method for Intelligent Human Behavior Analysis

Iris-LAHNet: a lightweight attention-guided high-resolution network for iris segmentation and localization

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

A Lightweight Adaptive RoI Extraction Network for Precise Aerial Image Instance Segmentation

CPISNet: Delving into Consistent Proposals of Instance Segmentation Network for High-Resolution Aerial Images

Two-stage Visual Cues Enhancement Network for Referring Image Segmentation

ITNet: Low-Shot Instance Transformation Network for Weakly Supervised Object Detection in Remote Sensing Images

IRNet: An Improved RetinaNet Model for Face Detection

An Enhanced Encoder-Decoder Network Architecture for Reducing Information Loss in Image Semantic Segmentation