Abstract:Automatic detection of multi-class objects in remote sensing images is a fundamental but challenging problem faced for remote sensing image analysis. Traditional methods are based on hand-crafted or shallow-learning-based features with limited representation power. Recently, deep learning algorithms, especially Faster region based convolutional neural networks (FRCN), has shown their much stronger detection power in computer vision field. However, several challenges limit the applications of FRCN in multi-class objects detection from remote sensing images: (1) Objects often appear at very different scales in remote sensing images, and FRCN with a fixed receptive field cannot match the scale variability of different objects; (2) Objects in large-scale remote sensing images are relatively small in size and densely peaked, and FRCN has poor localization performance with small objects; (3) Manual annotation is generally expensive and the available manual annotation of objects for training FRCN are not sufficient in number. To address these problems, this paper proposes a unified and effective method for simultaneously detecting multi-class objects in remote sensing images with large scales variability. Firstly, we redesign the feature extractor by adopting Concatenated ReLU and Inception module, which can increases the variety of receptive field size. Then, the detection is preformed by two sub-networks: a multi-scale object proposal network (MS-OPN) for object-like region generation from several intermediate layers, whose receptive fields match different object scales, and an accurate object detection network (AODN) for object detection based on fused feature maps, which combines several feature maps that enables small and densely packed objects to produce stronger response. For large-scale remote sensing images with limited manual annotations, we use cropped image blocks for training and augment them with re-scalings and rotations. The quantitative comparison results on the challenging NWPU VHR-10 data set, aircraft data set, Aerial-Vehicle data set and SAR-Ship data set show that our method is more accurate than existing algorithms and is effective for multi-modal remote sensing images.

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Dynamic Convolution Covariance Network Using Multiscale Feature Fusion for Remote Sensing Scene Image Classification

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

Remote Sensing Image Scene Classification Using Multiscale Feature Fusion Covariance Network with Octave Convolution

Fusing Deep Local And Global Features For Remote Sensing Image Scene Classification

A Multi-Scale Approach For Remote Sensing Scene Classification Based On Feature Maps Selection And Region Representation

Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification

Remote Sensing Scene Classification Using Sparse Representation-Based Framework with Deep Feature Fusion

Multi-scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks

A multi-scale dense residual correlation network for remote sensing scene classification

Multi-scale Neighborhood Information Fusion Network for Classification of Remote Sensing LiDAR Images

Effective Multiscale Residual Network With High-Order Feature Representation for Optical Remote Sensing Scene Classification

MGFN: A Multi-Granularity Fusion Convolutional Neural Network for Remote Sensing Scene Classification

DSHFNet: Dynamic Scale Hierarchical Fusion Network Based on Multiattention for Hyperspectral Image and LiDAR Data Classification

Multiscale and Multidirection Feature Extraction Network for Hyperspectral and LiDAR Classification

Attention-guided feature fusion and joint learning for remote sensing image scene classification

A Lightweight Convolutional Neural Network Based on Channel Multi-Group Fusion for Remote Sensing Scene Classification

Multilayer feature fusion using covariance for remote sensing scene classification

Deep Multi-Feature Fusion Network for Remote Sensing Images

A Multi-Scale Deep Feature Learning and Semantic Enhancement Approach for Remote Sensing Scene Classification

Multiscale Feature Adaptive Fusion for Object Detection in Optical Remote Sensing Images