Abstract:Automatic detection of multi-class objects in remote sensing images is a fundamental but challenging problem faced for remote sensing image analysis. Traditional methods are based on hand-crafted or shallow-learning-based features with limited representation power. Recently, deep learning algorithms, especially Faster region based convolutional neural networks (FRCN), has shown their much stronger detection power in computer vision field. However, several challenges limit the applications of FRCN in multi-class objects detection from remote sensing images: (1) Objects often appear at very different scales in remote sensing images, and FRCN with a fixed receptive field cannot match the scale variability of different objects; (2) Objects in large-scale remote sensing images are relatively small in size and densely peaked, and FRCN has poor localization performance with small objects; (3) Manual annotation is generally expensive and the available manual annotation of objects for training FRCN are not sufficient in number. To address these problems, this paper proposes a unified and effective method for simultaneously detecting multi-class objects in remote sensing images with large scales variability. Firstly, we redesign the feature extractor by adopting Concatenated ReLU and Inception module, which can increases the variety of receptive field size. Then, the detection is preformed by two sub-networks: a multi-scale object proposal network (MS-OPN) for object-like region generation from several intermediate layers, whose receptive fields match different object scales, and an accurate object detection network (AODN) for object detection based on fused feature maps, which combines several feature maps that enables small and densely packed objects to produce stronger response. For large-scale remote sensing images with limited manual annotations, we use cropped image blocks for training and augment them with re-scalings and rotations. The quantitative comparison results on the challenging NWPU VHR-10 data set, aircraft data set, Aerial-Vehicle data set and SAR-Ship data set show that our method is more accurate than existing algorithms and is effective for multi-modal remote sensing images.

Multi-RPN Fusion-based Sparse PCA-CNN Approach to Object Detection and Recognition for Robot-aided Visual System

Object Detection Based on Faster R-CNN Algorithm with Skip Pooling and Fusion of Contextual Information

Multi-Scale Object Detection Using Feature Fusion Recalibration Network

3D Object Detector: A Multiscale Region Proposal Network Based on Autonomous Driving.

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

FusionRCNN: LiDAR-Camera Fusion for Two-stage 3D Object Detection

Multi-scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks

Scalable Object Detection Using Deep But Lightweight Cnn With Features Fusion

One-Stage Multi-Sensor Data Fusion Convolutional Neural Network For 3d Object Detection

Object Detection from Images Based on MFF-RPN and Multi-scale CNN

PI-RCNN: An Efficient Multi-sensor 3D Object Detector with Point-based Attentive Cont-conv Fusion Module

Fusion Object Detection with Convolutional Neural Network

Multi-Channel CNN-based Object Detection for Enhanced Situation Awareness

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection

A method of cross-layer fusion multi-object detection and recognition based on improved faster R-CNN model in complex traffic environment

Multi-scale Feature Fusion with Point Pyramid for 3D Object Detection

Multi-View Fusion-Based 3D Object Detection for Robot Indoor Scene Perception

A Small Object Detection Algorithm Based on Improved Faster RCNN

A Multi-Scale Target Detection Method Using an Improved Faster Region Convolutional Neural Network Based on Enhanced Backbone and Optimized Mechanisms

CR-FPN: channel relation feature pyramid network for object detection

Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method