Hierarchical Attention Feature Fusion-Based Network for Land Cover Change Detection With Homogeneous and Heterogeneous Remote Sensing Images

Zhiyong Lv,Jie Liu,Weiwei Sun,Tao Lei,Jón Atli Benediktsson,Xiuping Jia
DOI: https://doi.org/10.1109/tgrs.2023.3334521
IF: 8.2
2023-12-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Deep learning techniques have become popular in land cover change detection (LCCD) with remote sensing images (RSIs). However, many existing networks mostly concentrate on learning deep features but without considering the effect of different features' attention and fusion strategy on detection performance. In this article, a novel hierarchical attention feature fusion (HAFF)-based network for LCCD with RSIs is proposed. In the proposed HAFF-based network, novel multiscale convolution fusion filters (MCFFs) explore the global semantic feature of the interested targets from multiperspective ways. To achieve that objective, the proposed MCFFs are composed by a well-known position attention module (PAM) and a novel multiperspectives feature filter block (MFFB) with different kernel sizes. In addition, a compound loss function was proposed for balancing the impact from the features at different levels in terms of backpropagation error. Experiments conducted on six pairs of real RSIs, including three pairs of homogeneous images and three pairs of heterogeneous images, confirmed the superiority of the proposed HAFF network over other cognate methods. Moreover, the ablation experiments further confirmed the feasibility and superiority of the proposed MCFFs, whereas quantitative observations indicated that competitive improvements are achieved by the proposed MCFFs in terms of all the evaluation indicators. The code for the proposed approach will be available at https://github.com/ImgSciGroup/HAFF.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?