TO–YOLOX: a pure CNN tiny object detection model for remote sensing images
Zhe Chen,Yuan Liang,Zhengbo Yu,Ke Xu,Qingyun Ji,Xueqi Zhang,Quanping Zhang,Zijia Cui,Ziqiong He,Ruichun Chang,Zhongchang Sun,Keyan Xiao,Huadong Guo,Zhe ChenYuan LiangZhengbo YuKe XuQingyun JiXueqi ZhangQuanping ZhangZijia CuiZiqiong HeRuichun ChangZhongchang SunKeyan XiaoHuadong Guoa School of Mathematics and Physics,Chengdu University of Technology,Chengdu,People's Republic of Chinab Key Laboratory of Digital Earth Science,Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing,People's Republic of Chinac International Research Centre of Big Data for Sustainable Development Goals,Beijing,People's Republic of Chinad Geomathematics Key Laboratory of Sichuan Province,Chengdu University of Technology,Chengdu,People's Republic of Chinae Digital Hu Line Research Institute,Chengdu University of Technology,Chengdu,People's Republic of Chinaf School of Management Science,Chengdu University of Technology,Chengdu,People's Republic of Chinag School of Earth Science and Resources,China University of Geosciences (Beijing),Beijing,People's Republic of Chinah MNR Key Laboratory of Metallogeny and Mineral Assessment,Institute of Mineral Resources,Chinese Academy of Geological Sciences,Beijing,People's Republic of China
DOI: https://doi.org/10.1080/17538947.2023.2261901
IF: 4.606
2023-09-25
International Journal of Digital Earth
Abstract:Remote sensing and deep learning are being widely combined in tasks such as urban planning and disaster prevention. However, due to interference occasioned by density, overlap, and coverage, the tiny object detection in remote sensing images has always been a difficult problem. Therefore, we propose a novel TO–YOLOX(Tiny Object–You Only Look Once) model. TO–YOLOX possesses a MiSo(Multiple-in-Single-out) feature fusion structure, which exhibits a spatial-shift structure, and the model balances positive and negative samples and enhances the information interaction pertaining to the local patch of remote sensing images. TO–YOLOX utilizes an adaptive IOU-T (Intersection Over Uni-Tiny) loss to enhance the localization accuracy of tiny objects, and it applies attention mechanism Group-CBAM (group-convolutional block attention module) to enhance the perception of tiny objects in remote sensing images. To verify the effectiveness and efficiency of TO–YOLOX, we utilized three aerial-photography tiny object detection datasets, namely VisDrone2021, Tiny Person, and DOTA–HBB, and the following mean average precision (mAP) values were recorded, respectively: 45.31% (+10.03%), 28.9% (+9.36%), and 63.02% (+9.62%). With respect to recognizing tiny objects, TO–YOLOX exhibits a stronger ability compared with Faster R-CNN, RetinaNet, YOLOv5, YOLOv6, YOLOv7, and YOLOX, and the proposed model exhibits fast computation.
geography, physical,remote sensing