MCMCNet: A Semi-supervised Road Extraction Network for High-resolution Remote Sensing Images Via Multiple Consistency and Multi-task Constraints

Lipeng Gao,Yiqing Zhou,Jiangtao Tian,Wenjing Cai,Zhiyong Lv
DOI: https://doi.org/10.1109/tgrs.2024.3426561
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Influenced by deep learning, extracting roads from high-resolution remote sensing images has attracted extensive attention. However, most previous works have focused on fully supervised models relying on large amounts of annotated data and have not considered the characteristics of narrow and elongated roads. In order to alleviate the model's dependency on labeled data, reduce annotation workload, and fully exploit road characteristics, we proposed a semi-supervised road extraction network via multiple consistency and multitask constraints (MCMCNet) that utilizes only minimal labeled data, while exploiting unlabeled data through the mining of pseudo-label information for constraint. Moreover, to ensure the generation of more accurate pseudo-labels, we incorporated a guided contrastive learning module (GCLM) into the model to increase interclass discriminability and enhance consistency constraints. In addition, to ensure the continuity of road extraction and integrity of the main roads, we added a road skeleton (road centerline) prediction head (RSPH) in addition to the original road segmentation prediction head. Finally, we introduced an adaptive road augment module (ARAM) to enhance linear road features and avoid learning redundant information by the use of local and global information adapted to road features. Extensive experiments demonstrated that MCMCNet achieved a 3%-5% improvement in $F1$ and IoU across three benchmark datasets, compared to other classical semi-supervised road extraction models, and the visualization results confirmed that MCMCNet partially addressed challenges including road occlusion, foreground-background high-similarity regions at extremely low label rates. The code is available at https://github.com/zhouyiqingzz/MCMCNet.
What problem does this paper attempt to address?