Abstract:Deep convolutional neural networks (DCNNs) are driving progress in object detection of high-resolution remote sensing images. Region proposal generation, as one of the key steps in object detection, has also become the focus of research. High-resolution remote sensing images usually contain various sizes of objects and complex background, small objects are easy to miss or be mis-identified in object detection. If the recall rate of region proposal of small objects and multi-scale objects can be improved, it will bring an improvement on the performance of the accuracy in object detection. Spatial attention is the ability to focus on local features in images and can improve the learning efficiency of DCNNs. This study proposes a multi-scale spatial attention region proposal network (MSA-RPN) for high-resolution optical remote sensing imagery. The MSA-RPN is an end-to-end deep learning network with a backbone network of ResNet. It deploys three novel modules to fulfill its task. First, the Scale-specific Feature Gate (SFG) focuses on features of objects by processing multi-scale features extracted from the backbone network. Second, the spatial attention-guided model (SAGM) obtains spatial information of objects from the multi-scale attention maps. Third, the Selective Strong Attention Maps Model (SSAMM) adaptively selects sliding windows according to the loss values from the system’s feedback, and sends the windowed samples to the spatial attention decoder. Finally, the candidate regions and their corresponding confidences can be obtained. We evaluate the proposed network in a public dataset LEVIR and compare with several state-of-the-art methods. The proposed MSA-RPN yields a higher recall rate of region proposal generation, especially for small targets in remote sensing images.

Spatial Attention Network for Head Detection.

HCNET: A Point Cloud Object Detection Network Based on Height and Channel Attention

HeadNet: an End-to-End Adaptive Relational Network for Head Detection

Scanet: Spatial-Channel Attention Network For 3d Object Detection

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Spatio-Temporal Self-Attention Network for Video Saliency Prediction

SARNet: Spatial Attention Residual Network for pedestrian and vehicle detection in large scenes

Spatial-Aware Non-Local Attention for Fashion Landmark Detection

CNN Network for Head Detection with Depth Images in cyber-physical systems

Spatial Attention Network for Few-Shot Learning

Ransp: Ranking Attention Network for Saliency Prediction on Omnidirectional Images

Hierarchical U-shape Attention Network for Salient Object Detection.

Delving into Salient Object Subitizing and Detection.

Spatial Self-Attention Network with Self-Attention Distillation for Fine-Grained Image Recognition

Towards accurate RGB-D saliency detection with complementary attention and adaptive integration

Head Detection Based on Convolutional Neural Network with Multi-Stage Weighted Feature

ASAN: Self-Attending and Semantic Activating Network Towards Better Object Detection

Saliency Prediction on Omnidirectional Images with Brain-Like Shallow Neural Network.

A Multi-Scale Spatial Attention Region Proposal Network for High-Resolution Optical Remote Sensing Imagery

A Spatial–Channel–Temporal-Fused Attention for Spiking Neural Networks