Abstract:Abstract. The urban road network detection and extraction have significant applications in many domains, such as intelligent transportation and navigation, urban planning, and automatic driving. Although manual annotation methods can provide accurate road network maps, their low efficiency with high-cost consumption are insufficient for the current tasks. Traditional methods based on spectral or geometric information rely on shallow features and often struggle with low semantic segmentation accuracy in complex remote sensing backgrounds. In recent years, deep convolutional neural networks (CNN) have provided robust feature representations to distinguish complex terrain objects. However, these CNNs ignore the fusion of global-local contexts and are often confused with other types of features, especially buildings. In addition, conventional convolution operations use a fixed template paradigm to aggregate local feature information. The road features present complex linear-shape geometric relationships, which brings some obstacles to feature construction. To address the above issues, we proposed a hybrid network structure that combines the advantages of CNN and transformer models. Specifically, a multiscale deformable convolution module has been developed to capture local road context information adaptively. The Transformer model is introduced into the encoder to enhance semantic information to build the global context. Meanwhile, the CNN features are fused with the transformer features. Finally, the model outputs a road extraction prediction map in high spatial resolution. Quantitative analysis and visual expression confirm that the proposed model can effectively and automatically extract road features from complex remote sensing backgrounds, outperforming state-of-the-art methods with IOU by 86.5% and OA by 97.4%.

RoadCT: A Hybrid CNN-Transformer Network for Road Extraction From Satellite Imagery

DCTNET: HYBRID NETWORK MODEL FUSING WITH MULTISCALE DEFORMABLE CNN AND TRANSFORMER STRUCTURE FOR ROAD EXTRACTION FROM GAOFEN SATELLITE REMOTE SENSING IMAGE

BDTNet: Road Extraction by Bi-Direction Transformer From Remote Sensing Images

DDCTNet: A Deformable and Dynamic Cross-Transformer Network for Road Extraction From High-Resolution Remote Sensing Images

TransRoadNet: A Novel Road Extraction Method for Remote Sensing Images via Combining High-Level Semantic Feature and Context

RoadFormer: Road Extraction Using a Swin Transformer Combined with a Spatial and Channel Separable Convolution

Global–Local Information Fusion Network for Road Extraction: Bridging the Gap in Accurate Road Segmentation in China

Multiscale Global Attention Network With Edge Perceptron for Automatic Road Extraction From Remote Sensing Imagery

Road Extraction From Remote Sensing Images via Channel Attention and Multilayer Axial Transformer

Seg-Road: A Segmentation Network for Road Extraction Based on Transformer and CNN with Connectivity Structures

Lightweight remote sensing road detection with an attention-augmented transformer

Road Extraction by Multi-scale Deformable Transformer from Remote Sensing Images

GA-Net: A geometry prior assisted neural network for road extraction

C2S-RoadNet: Road Extraction Model with Depth-Wise Separable Convolution and Self-Attention

A new two-step road extraction method in high resolution remote sensing images

Holistically-Nested Structure-Aware Graph Neural Network for Road Extraction

Swin Transformer coupling CNNs Makes Strong Contextual Encoders for VHR Image Road Extraction

Simultaneous Road Surface and Centerline Extraction From Large-Scale Remote Sensing Images Using CNN-Based Segmentation and Tracing

Road Extraction Convolutional Neural Network with Embedded Attention Mechanism for Remote Sensing Imagery

A Lightweight High-Resolution RS Image Road Extraction Method Combining Multi-Scale and Attention Mechanism

Fully Convolutional Network for Automatic Road Extraction from Satellite Imagery