Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection

Yong Zhou,Fengkai Wang,Jiaqi Zhao,Rui Yao,Silin Chen,Heping Ma
DOI: https://doi.org/10.1109/tcsvt.2022.3176055
IF: 5.859
2022-10-08
IEEE Transactions on Circuits and Systems for Video Technology
Abstract:The neural network-based remote sensing image change detection method faces a large amount of imaging interference and severe class imbalance problems under high-resolution conditions, which bring new challenges to the accuracy of the detection network. In this work, to address the imaging interference caused by different imaging angles and times, the siamese strategy and multi-head self-attention mechanism are used to reduce the imaging differences between the dual-temporal images and fully exploit the inter-temporal information. Secondly, a learnable multi-part feature learning module is used to adaptively exploit features from different scales to obtain more comprehensive features. Finally, a mixed loss function strategy is used to ensure that the network converges effectively and excludes the adverse interference of a large number of negative samples to the network. Extensive experiments show that our method outperforms numerous methods on LEVIR-CD, WHU, and DSIFN datasets.
engineering, electrical & electronic
What problem does this paper attempt to address?