Diffusion Models and Pseudo-Change: A Transfer Learning-Based Change Detection in Remote Sensing Images

Jia-Xin Wang,Teng Li,Si-Bao Chen,Cheng-Jie Gu,Zhi-Hui You,Bin Luo
DOI: https://doi.org/10.1109/tgrs.2024.3484526
IF: 8.2
2024-11-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Remote sensing (RS) image change detection (CD) has been a research hotspot in recent years, which plays an important role in urban planning and disaster assessment. However, since CD labels are difficult to obtain, how to utilize semantic information in RS images to improve the change prediction performance is a problem worth exploring. To solve this problem, we propose a transfer learning-based CD method that utilizes a diffusion generation model to translate high-level semantic information into low-level change information. First, we propose a pseudo-change image pair generation method that utilizes semantic labels to guide the diffusion model to generate change images. Then, the refined loss (RL) is designed to improve the model's ability to recognize change features based on the difference between pseudo-change image pairs and unlabeled image pairs. Experimental results on WHU-CD, LEVIR-CD, and GoogleGZ-CD datasets show that the proposed method effectively transfers the semantic information into change information and finally improves the model's feature recognition ability for change objects. Compared with recent CD and transfer learning methods, the proposed transfer learning model (TLM) achieves the best performance. The source code is available at https://github.com/VCISwang/STCD.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?