Integrating SAM With Feature Interaction for Remote Sensing Change Detection

Da Zhang,Feiyu Wang,Lichen Ning,Zhiyuan Zhao,Junyu Gao,Xuelong Li
DOI: https://doi.org/10.1109/tgrs.2024.3483775
IF: 8.2
2024-11-09
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Vision foundation models (VFMs) have rapidly gained application across various visual scenarios due to their robust universality and generalization capabilities. However, when directly applied to remote sensing images (RSIs), their performance often falls short owing to the unique inherent imaging characteristics. Moreover, these models typically suffer from inadequate feature extraction capabilities and unclear boundary detection because of the lack of specialized knowledge in the remote sensing (RS) field. To ameliorate these issues, we propose SFCD-Net, a novel network integrating SAM with feature interaction for RS change detection. To be specific, we first introduce a parameter-efficient fine-tuning (PEFT) method that allows the model to learn domain-specific knowledge, thereby enhancing its fine-grained feature extraction capability. Second, an innovative bitemporal feature interaction (BFI) module is designed to improve the model's sensitivity to changes. Finally, we use the boundary loss function (BLF) to enhance the model's ability to process boundary details, thereby improving its performance in recognizing boundaries and small targets. Through a series of ablation studies and comparative experiments, we demonstrate that the proposed SFCD-Net significantly improves model adaptability in RS tasks under limited computational resources, outperforming existing models.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?