Abstract:Extracting roads from remote sensing images is of significant importance for automatic road network updating, urban planning, and construction. However, various factors in complex scenes (e.g., high vegetation coverage occlusions) may lead to fragmentation in the extracted road networks and also affect the robustness of road extraction methods. This study proposes a multi-scale road extraction method with asymmetric generative adversarial learning (MS-AGAN). First, we design an asymmetric GAN with a multi-scale feature encoder to better utilize the context information in high-resolution remote sensing images (HRSIs). Atrous spatial pyramid pooling (ASPP) and feature fusion are integrated into the asymmetric encoder–decoder structure to avoid feature redundancy caused by multi-level cascading operations and enhance the generator network's ability to extract fine-grained road information at the pixel level. Second, to maintain road connectivity, topologic features are considered in the pixel segmentation process. A linear structural similarity loss (LSSIM) is introduced into the loss function of MS-AGAN, which guides MS-AGAN to generate more accurate segmentation results. Finally, to fairly evaluate the performance of deep models under complex backgrounds, the Bayesian error rate (BER) is introduced into the field of road extraction for the first time. Experiments are conducted via Gaofen-2 (GF-2) high-resolution remote sensing images with high vegetation coverage in the Daxing District of Beijing, China, and the public DeepGlobe dataset. The performance of MS-AGAN is compared with a list of advanced models, including RCFSNet, CoANet, UNet, DeepLabV3+, and DiResNet. The final results show that (1) with respect to road extraction performance, the Recall, F1, and IoU values of MS-AGAN on the Daxing dataset are 2.17%, 0.04%, and 2.63% higher than the baselines. On DeepGlobe, the Recall, F1, and IoU of MS-AGAN improve by 1.12%, 0.42%, and 0.25%, respectively. (2) On road connectivity, the Conn index of MS-AGAN from the Daxing dataset is 46.39%, with an improvement of 0.62% over the baselines, and the Conn index of MS-AGAN on DeepGlobe is 70.08%, holding an improvement of 1.73% over CoANet. The quantitative and qualitative analyses both demonstrate the superiority of MS-AGAN in preserving road connectivity. (3) In particular, the BER of MS-AGAN is 20.86% over the Daxing dataset with a 0.22% decrease compared to the best baselines and 11.77% on DeepGlobe with a 0.85% decrease compared to the best baselines. The proposed MS-AGAN provides an efficient, cost-effective, and reliable method for the dynamic updating of road networks via HRSIs.

Aggregation segregation generative adversarial network (AG-GAN) facilitated multi-scale segregation detection in asphalt pavement paving stage

Automatic intelligent recognition of pavement distresses with limited dataset using generative adversarial networks

A Coarse Aggregate Gradation Detection Method Based on 3D Point Cloud

A Deeply Supervised Semantic Segmentation Method Based on GAN

MS-AGAN: Road Extraction via Multi-Scale Information Fusion and Asymmetric Generative Adversarial Networks from High-Resolution Remote Sensing Images under Complex Backgrounds

Aggregate boundary recognition of asphalt mixture CT images based on convolutional neural networks

Improving Road Semantic Segmentation Using Generative Adversarial Network

A deeper generative adversarial network for grooved cement concrete pavement crack detection

Virtual generation of pavement crack images based on improved deep convolutional generative adversarial network

Revisiting Generative Adversarial Networks for Binary Semantic Segmentation on Imbalanced Datasets

A pavement crack synthesis method based on conditional generative adversarial networks

Rapid extraction of pavement aggregate gradation based on point clouds using deep learning networks

Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model

Automatic augmentation and segmentation system for three-dimensional point cloud of pavement potholes by fusion convolution and transformer

Intelligent Pixel‐level Detection of Multiple Distresses and Surface Design Features on Asphalt Pavements

CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning

Intelligent pixel-level pavement marking detection using 2D laser pavement images

SS-GAN based road surface crack region segmentation and forecasting

Automatic Pavement Type Recognition for Image-Based Pavement Condition Survey Using Convolutional Neural Network.

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

A generative adversarial network approach for removing motion blur in the automatic detection of pavement cracks