Adaptive Multilevel Fusion Refinement Network for Object Detection in Remote Sensing Images

Yu Wang,Hao Chen,Ye Zhang,Guozheng Li,Xing Yan
DOI: https://doi.org/10.1109/lgrs.2024.3402246
IF: 5.343
2024-01-01
IEEE Geoscience and Remote Sensing Letters
Abstract:The majority of existing object detection models struggle to fully exploit the intimate relationship between scene context and objects, and the feature fusion and proposal generation strategies tend to be relatively basic, resulting in poor model performance. To address these issues, we propose an object detection model based on adaptive multilevel fusion refinement network. Firstly, we propose an adaptive gated fusion network that dynamically assesses correlations between objects and scene information, generating a gated feature map to guide feature fusion and extract discriminative joint object-context features. Next, a proposal refinement model is proposed. By utilizing a learnable correlation-weighted coefficient, this model effectively merges low-level features with joint features, thereby mitigating spatial information deficits. We also propose an adaptive multidimensional offset strategy, which minimizes the impact of regression deviations on proposal quality by combining information offsets and spatial offsets. To optimize all subtasks, a novel multi-task loss function is proposed. Evaluated on the DOTA and HRSC2016 datasets shows that our method is superior to compared methods in object detection and harvests 77.26% and 90.68% mean average precision, respectively.
What problem does this paper attempt to address?