Abstract:Automatic detection of multi-class objects in remote sensing images is a fundamental but challenging problem faced for remote sensing image analysis. Traditional methods are based on hand-crafted or shallow-learning-based features with limited representation power. Recently, deep learning algorithms, especially Faster region based convolutional neural networks (FRCN), has shown their much stronger detection power in computer vision field. However, several challenges limit the applications of FRCN in multi-class objects detection from remote sensing images: (1) Objects often appear at very different scales in remote sensing images, and FRCN with a fixed receptive field cannot match the scale variability of different objects; (2) Objects in large-scale remote sensing images are relatively small in size and densely peaked, and FRCN has poor localization performance with small objects; (3) Manual annotation is generally expensive and the available manual annotation of objects for training FRCN are not sufficient in number. To address these problems, this paper proposes a unified and effective method for simultaneously detecting multi-class objects in remote sensing images with large scales variability. Firstly, we redesign the feature extractor by adopting Concatenated ReLU and Inception module, which can increases the variety of receptive field size. Then, the detection is preformed by two sub-networks: a multi-scale object proposal network (MS-OPN) for object-like region generation from several intermediate layers, whose receptive fields match different object scales, and an accurate object detection network (AODN) for object detection based on fused feature maps, which combines several feature maps that enables small and densely packed objects to produce stronger response. For large-scale remote sensing images with limited manual annotations, we use cropped image blocks for training and augment them with re-scalings and rotations. The quantitative comparison results on the challenging NWPU VHR-10 data set, aircraft data set, Aerial-Vehicle data set and SAR-Ship data set show that our method is more accurate than existing algorithms and is effective for multi-modal remote sensing images.

Efficient Fine-Grained Object Recognition in High-Resolution Remote Sensing Images From Knowledge Distillation to Filter Grafting

Fine-Grained Object Detection in Remote Sensing Images Via Adaptive Label Assignment and Refined-Balanced Feature Pyramid Network.

Incremental Detection of Remote Sensing Objects with Feature Pyramid and Knowledge Distillation

A Scale-aware and Discriminative Feature Learning Network for Fine-grained Rigid Object Recognition

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

Fine-Grained Image Recognition Methods and Their Applications in Remote Sensing Images: A Review

Global to Local: A Scale-Aware Network for Remote Sensing Object Detection.

Information Fusion with Knowledge Distillation for Fine-grained Remote Sensing Object Detection

Feature Pyramid Full Granularity Attention Network for Object Detection in Remote Sensing Imagery

Auto Learner of Objects Co-Occurrence Knowledge for Object Detection in Remote Sensing Images.

Classifying High Resolution Remote Sensing Images by Fine-Tuned VGG Deep Networks

Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images

Structure-Guided Feature Transform Hybrid Residual Network for Remote Sensing Object Detection

Guiding Clean Features for Object Detection in Remote Sensing Images

SFRNet: Fine-Grained Oriented Object Recognition via Separate Feature Refinement

An Efficient And Robust Integrated Geospatial Object Detection Framework For High Spatial Resolution Remote Sensing Imagery

Knowledge Graph Representation Fusion Framework for Fine-Grained Object Recognition in Smart Cities

InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images

A Deep CNN-Based Detection Method for Multi-Scale Fine-Grained Objects in Remote Sensing Images

Small Object Detection in Optical Remote Sensing Video with Motion Guided R-CNN.

Multi-scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks