DTHNet: Dual-Stream Network Based on Transformer and High-Resolution Representation for Shadow Extraction from Remote Sensing Imagery

Shuang Zhang,Yungang Cao,Baikai Sui
DOI: https://doi.org/10.1109/lgrs.2023.3290176
IF: 5.343
2023-01-01
IEEE Geoscience and Remote Sensing Letters
Abstract:Shadow extraction from remote sensing images is critical work. However, the interclass similarity of shadows with dark water, trees, and roads and the dependence on other objects make accurate shadow extraction still challenging. This letter proposes a dual-stream network (DTHNet) based on the transformer and high-resolution representation for multiscale shadow extraction. The DTHNet utilizes two streams: the high-resolution representation stream extracts deep features while maintaining detail information, and the clustering representation stream provides clustering feature constraints to enhance the ability to distinguish between foreground and background. Additionally, the designed multiscale auxiliary predictor (MAP) and hybrid loss aid in extracting multiscale shadows. We evaluated our proposed method on the aerial imagery dataset for shadow detection (AISD) dataset and compared it against six state-of-the-art generic semantic segmentation models and shadow extraction methods. The experimental results demonstrate that the DTHNet outperforms the existing methods.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?