Remote Sensing Semantic Change Detection Model for Improving Objects Completeness

Wanying Yang,Yali Cheng,Wenbo Xu
DOI: https://doi.org/10.1109/jstars.2024.3493945
IF: 4.715
2024-01-01
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Abstract:Semantic change detection (SCD) extends beyond binary change detection (BCD) by not only discerning the locations of change areas but also offering the alterations in landcover/land-use (LULC) types. This refined change information is concernful for various applications. While deep learning methods have made significant progress in semantic change detection, accurately capturing the integrity of targets remains challenging in intricate scenarios. Therefore, this paper proposes a deformable multi-scale composite transformer network (DMCTNet). This network effectively models relevant semantic information and spatio-temporal dependencies. DMCTNet leverages a variant Vision Foundation Models (VFMs) encoder to learn specific knowledge, facilitating effective visual representation in remote sensing images (RSIs). A multi-scale feature aggregator module is developed to discern both the ‘what’ and ‘where’ of changes by integrating features across different scales. Subsequently, a masked decoder throughs queries to convey rich semantic change information, guided by conspicuous change potential locations to decode. A substantial volume of experimental results consistently demonstrate that this model achieves more accurate and reliable results in change areas, improving the intersection over the union (IoU) of change by 2.65% and 1.67% on the SECOND and LandsatSCD datasets, respectively. Code will be made available.
What problem does this paper attempt to address?