A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images
Tao Gao,Zixiang Liu,Jing Zhang,Guiping Wu,Ting Chen
DOI: https://doi.org/10.1109/tgrs.2023.3289878
IF: 8.2
2023-07-07
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Object detection is essential in the interpretation of remote sensing images (RSIs). However, the blurred background and objects with vast variances are identified as the two main challenges of the task. We propose a novel detector adapted to a complicated background and multiscale objects, namely, task-balanced multiscale adaptive fusion network (TMAFNet), targeting directly on the above two challenges. First, a depth separable global context (DSGC) module is constructed to understand contextual relations among pixels from a global perspective, which is extraordinarily necessary to distinguish objects from the environment. Most importantly, DSGC reduces the computational cost by decoupling the acquisition of global information into single-channel global interaction and multichannel single-point interaction. Second, in order to eliminate disturbance and enhance the representation ability of objects, hidden recursive feature pyramid network (HRFPN) is explored, which encodes the information of difference before and after using the multiscale fusion. HRFPN is proven to enhance the target features by reducing the background noise. Third, a semicoupling task-balanced (SCTB) head is presented to guarantee the consistency of detection. We have conducted comprehensive experiments on several publicly available datasets, and the results illustrate that our modules improve adaptability and robustness of the network, leading to a new state-of-the-art.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics