ALNet: Auxiliary Learning-Based Network for Weakly Supervised Building Extraction From High-Resolution Remote Sensing Images
Xin Yan,Li Shen,Junjie Pan,Jicheng Wang,Chao Chen,Zhilin Li
DOI: https://doi.org/10.1109/tgrs.2023.3314465
IF: 8.2
2023-09-30
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Weakly supervised semantic segmentation (WSSS) based on image-level labels can reduce the expensive costs of annotating pixel-level labels, and it has achieved great progress by generating class activation maps (CAMs) as pseudo-labels for training a segmentation model. However, it is challenging to generate high-quality CAMs due to the large supervision gap between classification and segmentation. To aid in mitigating the supervision gap, we first designed a simple but effective feature-to-image restoration (FTIR) branch to acquire supplementary pixel-wise supervisory information. Second, to effectively utilize FTIR supervision in addressing the supervision gap, we have developed an auxiliary learning-based network (ALNet) that incorporates the FTIR as an auxiliary task to support the primary WSSS task. By integrating them into a unified framework, the proposed network can leverage the FTIR supervision to enhance the performance of WSSS. Third, we propose a semantic-aware multilevel feature progressive aggregation module (SMPA) to enhance the fusion of multilevel features, accommodating the varying feature requirements of the two distinct tasks at different levels of granularity. Finally, we also introduce a global reasoning augmentation module (GloRe) into our model to further strengthen global correlations between similar building objects. Extensive experiments on public high-resolution remote sensing images (HRSI) building datasets, including the WHU dataset and the InriaAID dataset, demonstrate that with the assistance of the FTIR, the proposed ALNet with the SMPA and the GloRe can produce more integral and accurate CAMs for weakly supervised building extraction in HRSIs, and achieve state-of-the-art performance that significantly surpasses other WSSS methods.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics