Abstract:Road extraction from very high-resolution (VHR) remote sensing imagery remains a huge challenge, due to the shadows and occlusions of trees and buildings. Such complex backgrounds result in deep networks often producing fragmented roads with poor connectivity. Road extraction has three typical tasks: road surface segmentation (SS), centerline extraction (CE), and edge detection (ED), which are conducted in a wide range of real applications. Also, the three tasks have a symbiotic relationship, i.e., the road SS determines the location of the centerline and edges, and the CE and ED can allow the generation of more continuous road surfaces. However, most of the previous works have completed these three tasks separately, without exploiting the symbiotic relationship between them to boost the road connectivity. In this article, in order to improve road connectivity, a cascaded multitask (CasMT) road extraction framework for simultaneously extracting the road surface, centerline, and edges is proposed. In the proposed framework, topology-aware learning is applied to capture the long-distance topological relationships, and hard example mining (HEM) loss is employed to focus more on hard samples, to further enhance the road completeness. Extensive experiments were conducted on the DeepGlobe road dataset and a large-scale road dataset (called the LSCC dataset) from the three Chinese cities of Beijing, Shanghai, and Wuhan. The experimental results obtained on the public DeepGlobe dataset demonstrate that the proposed CasMT framework can significantly outperform the current state-of-the-art method. Moreover, the generalization capability of the model was verified on the LSCC dataset, where the proposed CasMT framework achieved the best performance in the average path length similarity (APLS) road topology metric, which further confirms the superiority of the proposed framework.

Topology-aware Road Extraction Via Multi-task Learning for Autonomous Driving

Topology-Enhanced Urban Road Extraction via a Geographic Feature-Enhanced Network

Road Topology Extraction Based on Point of Interest Guidance and Graph Convolutional Neural Network From High-Resolution Remote Sensing Images

Fine-Grained Extraction of Road Networks via Joint Learning of Connectivity and Segmentation

Topology-Guided Road Graph Extraction from Remote Sensing Images

Graph-based Topology Reasoning for Driving Scenes

Topology-Aware Road Network Extraction Via Multi-Supervised Generative Adversarial Networks.

MCMCNet: A Semi-supervised Road Extraction Network for High-resolution Remote Sensing Images Via Multiple Consistency and Multi-task Constraints

A Multi-Task Road Feature Extraction Network with Grouped Convolution and Attention Mechanisms

Road Graph Extraction via Transformer and Topological Representation

An End-to-End Multi-Task Learning Model for Drivable Road Detection via Edge Refinement and Geometric Deformation

Holistically-Nested Structure-Aware Graph Neural Network for Road Extraction

Multiscale Global Attention Network With Edge Perceptron for Automatic Road Extraction From Remote Sensing Imagery

Seg-Road: A Segmentation Network for Road Extraction Based on Transformer and CNN with Connectivity Structures

Automatic Road Extraction with Multi-Source Data Revisited: Completeness, Smoothness and Discrimination

LiDAR-Based Multi-Task Road Perception Network for Autonomous Vehicles

Cascaded Multi-Task Road Extraction Network for Road Surface, Centerline, and Edge Extraction

Automatic Road Extraction from High-Resolution Remote Sensing Images Using a Method Based on Densely Connected Spatial Feature-Enhanced Pyramid

CoA-DLinkNet: Connectivity-Enhanced Dual-Branch Road Extraction Network Based on D-LinkNet

Automatic extraction and 3D modeling of real road scenes using UAV imagery and deep learning semantic segmentation

TopoSD: Topology-Enhanced Lane Segment Perception with SDMap Prior