Adjacent-level Feature Cross-Fusion with 3D CNN for Remote Sensing Image Change Detection.

Yuanxin Ye,Mengmeng Wang,Liang Zhou,Guangyang Lei,Jianwei Fan,Yao Qin
DOI: https://doi.org/10.1109/tgrs.2023.3305499
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Deep learning-based change detection (CD) using remote sensing images hasreceived increasing attention in recent years. However, how to effectivelyextract and fuse the deep features of bi-temporal images for improving theaccuracy of CD is still a challenge. To address that, a novel adjacent-levelfeature fusion network with 3D convolution (named AFCF3D-Net) is proposed inthis article. First, through the inner fusion property of 3D convolution, wedesign a new feature fusion way that can simultaneously extract and fuse thefeature information from bi-temporal images. Then, to alleviate the semanticgap between low-level features and high-level features, we propose anadjacent-level feature cross-fusion (AFCF) module to aggregate complementaryfeature information between the adjacent levels. Furthermore, the full-scaleskip connection strategy is introduced to improve the capability of pixel-wiseprediction and the compactness of changed objects in the results. Finally, theproposed AFCF3D-Net has been validated on the three challenging remote sensingCD datasets: the Wuhan building dataset (WHU-CD), the LEVIR building dataset(LEVIR-CD), and the Sun Yat-Sen University dataset (SYSU-CD). The results ofquantitative analysis and qualitative comparison demonstrate that the proposedAFCF3D-Net achieves better performance compared to other state-of-the-artmethods. The code for this work is available athttps://github.com/wm-Githuber/AFCF3D-Net.
What problem does this paper attempt to address?