Abstract:Abstract. The urban road network detection and extraction have significant applications in many domains, such as intelligent transportation and navigation, urban planning, and automatic driving. Although manual annotation methods can provide accurate road network maps, their low efficiency with high-cost consumption are insufficient for the current tasks. Traditional methods based on spectral or geometric information rely on shallow features and often struggle with low semantic segmentation accuracy in complex remote sensing backgrounds. In recent years, deep convolutional neural networks (CNN) have provided robust feature representations to distinguish complex terrain objects. However, these CNNs ignore the fusion of global-local contexts and are often confused with other types of features, especially buildings. In addition, conventional convolution operations use a fixed template paradigm to aggregate local feature information. The road features present complex linear-shape geometric relationships, which brings some obstacles to feature construction. To address the above issues, we proposed a hybrid network structure that combines the advantages of CNN and transformer models. Specifically, a multiscale deformable convolution module has been developed to capture local road context information adaptively. The Transformer model is introduced into the encoder to enhance semantic information to build the global context. Meanwhile, the CNN features are fused with the transformer features. Finally, the model outputs a road extraction prediction map in high spatial resolution. Quantitative analysis and visual expression confirm that the proposed model can effectively and automatically extract road features from complex remote sensing backgrounds, outperforming state-of-the-art methods with IOU by 86.5% and OA by 97.4%.

A Context-Aware Road Extraction Method for Remote Sensing Imagery Based on Transformer Network

Road Extraction From Remote Sensing Images via Channel Attention and Multilayer Axial Transformer

Lightweight remote sensing road detection with an attention-augmented transformer

A Saliency-Aware Deep Network for Narrow Road Extraction of High-Resolution Remote Sensing Imagery

RoadFormer: Road Extraction Using a Swin Transformer Combined with a Spatial and Channel Separable Convolution

Road Extraction from Remote Sensing Imagery with Spatial Attention Based on Swin Transformer

TransRoadNet: A Novel Road Extraction Method for Remote Sensing Images via Combining High-Level Semantic Feature and Context

Road Extraction by Multi-scale Deformable Transformer from Remote Sensing Images

BDTNet: Road Extraction by Bi-Direction Transformer From Remote Sensing Images

Road Extraction From Satellite Imagery by Road Context and Full-Stage Feature

Swin Transformer coupling CNNs Makes Strong Contextual Encoders for VHR Image Road Extraction

DDCTNet: A Deformable and Dynamic Cross-Transformer Network for Road Extraction From High-Resolution Remote Sensing Images

DCTNET: HYBRID NETWORK MODEL FUSING WITH MULTISCALE DEFORMABLE CNN AND TRANSFORMER STRUCTURE FOR ROAD EXTRACTION FROM GAOFEN SATELLITE REMOTE SENSING IMAGE

Detecting Lane and Road Markings at A Distance with Perspective Transformer Layers

Cascaded Residual Attention Enhanced Road Extraction from Remote Sensing Images

Context-aware Method for Small Object Segmentation in Road Scenes.

Semantic-Aware Context Modeling for Road Extraction in Remote Sensing Images

Road Extraction from High-Resolution Remote Sensing Images via Local and Global Context Reasoning

MECA-Net: A MultiScale Feature Encoding and Long-Range Context-Aware Network for Road Extraction from Remote Sensing Images

Multiscale Global Attention Network With Edge Perceptron for Automatic Road Extraction From Remote Sensing Imagery

Seg-Road: A Segmentation Network for Road Extraction Based on Transformer and CNN with Connectivity Structures