Abstract:Small object detection in remote sensing enables the identification and analysis of unapparent but important information, playing a crucial role in various ground monitoring tasks. Due to the small size, the available feature information contained in small objects is very limited, making them more easily buried by the complex background. As one of the research hotspots in remote sensing, although many breakthroughs have been made, there still exist two significant shortcomings for the existing approaches: first, the down-sampling operation commonly used for feature extraction can barely preserve weak features of objects in a tiny size; second, the convolutional neural network methods have limitations in modeling global context to address cluttered backgrounds. To tackle these issues, a high-resolution network with transformer embedding parallel detection (HRTP-Net) is proposed in this paper. A high-resolution feature fusion network (HR-FFN) is designed to solve the first problem by maintaining high spatial resolution features with enhanced semantic information. Furthermore, a Swin-transformer-based mixed attention module (STMA) is proposed to augment the object information in the transformer block by establishing a pixel-level correlation, thereby enabling global background–object modeling, which can address the second shortcoming. Finally, a parallel detection structure for remote sensing is constructed by integrating the attentional outputs of STMA with standard convolutional features. The proposed method effectively mitigates the impact of the intricate background on small objects. The comprehensive experiment results on three representative remote sensing datasets with small objects (MASATI, VEDAI and DOTA datasets) demonstrate that the proposed HRTP-Net achieves a promising and competitive performance.

Object Detection in Very High-Resolution Aerial Images Using One-Stage Densely Connected Feature Pyramid Network

Multi-Scale Feature Integrated Attention-Based Rotation Network for Object Detection in VHR Aerial Images

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

Multi-Stage Feature Enhancement Pyramid Network for Detecting Objects in Optical Remote Sensing Images

End-To-End Airport Detection In Remote Sensing Images Combining Cascade Region Proposal Networks And Multi-Threshold Detection Networks

A Two-Way Dense Feature Pyramid Networks for Object Detection of Remote Sensing Images

Robust Object Detection For Tiny And Dense Targets In Vhr Aerial Images

EFP-Net: High-Precision Remote Sensing Image Object Detection

Object Detection for Rotated and Densely Arranged Objects in Aerial Images Using Path Aggregated Feature Pyramid Networks

Multi-Branch Parallel Networks for Object Detection in High-Resolution UAV Remote Sensing Images

A multi-scale pyramid feature fusion-based object detection method for remote sensing images

Multi-scale Oriented Object Detection in Aerial Images Based on Convolutional Neural Networks with Global Attention

Novel Up-Scale Feature Aggregation for Object Detection in Aerial Images

Object Detection in Remote Sensing Images Based on a Scene-Contextual Feature Pyramid Network

Bidirectional parallel multi-branch convolution feature pyramid network for target detection in aerial images of swarm UAVs

An Efficient Feature Pyramid Network for Object Detection in Remote Sensing Imagery

Reverse Densely Connected Feature Pyramid Network For Object Detection

Dense Multiscale Feature Fusion Pyramid Networks for Object Detection in UAV-Captured Images

ARFP: A novel adaptive recursive feature pyramid for object detection in aerial images

High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images

An Efficient And Robust Integrated Geospatial Object Detection Framework For High Spatial Resolution Remote Sensing Imagery