Tiny Object Detection in Remote Sensing Images Based on Object Reconstruction and Multiple Receptive Field Adaptive Feature Enhancement

Dongyang Liu,Junping Zhang,Yunxiao Qi,Yinhu Wu,Ye Zhang
DOI: https://doi.org/10.1109/tgrs.2024.3381774
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Tiny object detection in the field of remote sensing has always been a challenging and interesting topic. Despite many researchers working on this problem, it has not been well-solved due to its complexity. In this article, we analyze the reasons for poor performance of deep-learning-based object detection methods for tiny objects in remote sensing images. Moreover, we propose a new remote sensing image tiny object detection network based on object reconstruction and multiple receptive field adaptive feature enhancement module (MRFAFEM), called ORFENet. Detailedly, object reconstruction aims to reduce the information loss of tiny objects within deep neural networks, which is only used in the training phase and can be discarded in the inference phase. MRFAFEM is designed to enhance the features for detecting tiny objects by dynamically adjusting the multiple receptive field features. We have conducted several experiments on the AI-TODv2 and LEVIR-Ship datasets, both of which are proposed for tiny object detection in remote sensing images. The experimental results indicate the effectiveness of the proposed method. Specifically, the proposed ORFENet can achieve an average precision (AP) of 24.8% on the AI-TODv2 dataset and 83.3% AP50 on the LEVIR-Ship dataset. The code will be released at https://github.com/dyl96/ORFENet.
What problem does this paper attempt to address?