Abstract:Automatic detection of multi-class objects in remote sensing images is a fundamental but challenging problem faced for remote sensing image analysis. Traditional methods are based on hand-crafted or shallow-learning-based features with limited representation power. Recently, deep learning algorithms, especially Faster region based convolutional neural networks (FRCN), has shown their much stronger detection power in computer vision field. However, several challenges limit the applications of FRCN in multi-class objects detection from remote sensing images: (1) Objects often appear at very different scales in remote sensing images, and FRCN with a fixed receptive field cannot match the scale variability of different objects; (2) Objects in large-scale remote sensing images are relatively small in size and densely peaked, and FRCN has poor localization performance with small objects; (3) Manual annotation is generally expensive and the available manual annotation of objects for training FRCN are not sufficient in number. To address these problems, this paper proposes a unified and effective method for simultaneously detecting multi-class objects in remote sensing images with large scales variability. Firstly, we redesign the feature extractor by adopting Concatenated ReLU and Inception module, which can increases the variety of receptive field size. Then, the detection is preformed by two sub-networks: a multi-scale object proposal network (MS-OPN) for object-like region generation from several intermediate layers, whose receptive fields match different object scales, and an accurate object detection network (AODN) for object detection based on fused feature maps, which combines several feature maps that enables small and densely packed objects to produce stronger response. For large-scale remote sensing images with limited manual annotations, we use cropped image blocks for training and augment them with re-scalings and rotations. The quantitative comparison results on the challenging NWPU VHR-10 data set, aircraft data set, Aerial-Vehicle data set and SAR-Ship data set show that our method is more accurate than existing algorithms and is effective for multi-modal remote sensing images.

Spatial Attention for Multi-Scale Feature Refinement for Object Detection.

Multi-Scale Feature Integrated Attention-Based Rotation Network for Object Detection in VHR Aerial Images

Improving Multiscale Object Detection With Off-Centered Semantics Refinement

Feature refinement with multi-level context for object detection

Feature Refinement from Multiple Perspectives for High Performance Salient Object Detection.

Boundary-aware Small Object Detection with Attention and Interaction

Remote Sensing Object Detection Based on Receptive Field Expansion Block

MFRENet: efficient detection of drone image based on multiscale feature aggregation and receptive field expanded

Multi-scale iterative refinement network for RGB-D salient object detection

Multi-Attention Object Detection Model in Remote Sensing Images Based on Multi-Scale

FFR-SSD: feature fusion and reconstruction single shot detector for multi-scale object detection

Object Detection With Extended Attention And Spatial Information

Small object detection based on attention mechanism and enhanced network

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

ORCNN-X: Attention-Driven Multiscale Network for Detecting Small Objects in Complex Aerial Scenes

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

Multi-scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks

Drone Detection Based on Multi-scale Feature Fusion.

A Multi-Scale Spatial Attention Region Proposal Network for High-Resolution Optical Remote Sensing Imagery

Concise Feature Pyramid Region Proposal Network for Multi-Scale Object Detection.

Feature-Attentioned Object Detection in Remote Sensing Imagery.