Abstract:Urban road extraction is important for the applications of urban planning and transportation. High-resolution image (HRI) has been one of the most popular data sources for extracting roads with high efficiency and low cost. However, roads in HRI are easily obscured by buildings, trees, and other landscapes, resulting in discontinuity of the extracted roads. While current road extraction techniques by multimodal data fusion have shown improved results compared to single-modal methods by incorporating additional information, most existing fusion methods fail to fully exploit the features from different modalities and consider prior knowledge of roads. To address the above problems, a dual encoder-based cross-modal complementary fusion network (DECCFNet) is proposed in this article. The proposed network takes full advantage of the rich feature information contained in HRI and the immunity of LiDAR data to the influence of shadows. By effectively fusing the complementary information from HRI and LiDAR data, DECCFNet, respectively, achieved an improvement by at least 2.94% and 2.8% in IOU compared to those only using a single data modality on the two datasets. The proposed DECCFNet mainly contains two modules: 1) cross-modal feature fusion (CMFF) module: in the dual encoder part, CMFF is employed to fuse the deep features of different modalities from the channel and spatial dimension, while a multiscale fusion strategy is utilized to extract the contextual information; 2) multi-direction strip convolution (MDSC) module: since roads have the characteristics of narrowness and continuity, adopting classical convolution kernels directly on road features may introduce irrelevant pixels into the computation, blurring the extraction results. To mitigate this issue, MDSC is applied to strip the convolution of road features from multiple directions based on square convolution and make the network focus more on the specific road features. By comparing several deep-learning multimodal data fusion networks in the two road datasets, the proposed network exhibits the best road extraction results.

DeepExt: A Convolution Neural Network for Road Extraction using RGB images captured by UAV

Deep TEC: Deep Transfer Learning with Ensemble Classifier for Road Extraction from UAV Imagery

UFCN: a fully convolutional neural network for road extraction in RGB imagery acquired by remote sensing from an unmanned aerial vehicle

A Saliency-Aware Deep Network for Narrow Road Extraction of High-Resolution Remote Sensing Imagery

Fully Convolutional Network for Automatic Road Extraction from Satellite Imagery

AM-UNet: Road Network Extraction from high-resolution Aerial Imagery Using Attention-Based Convolutional Neural Network

Automatic extraction and 3D modeling of real road scenes using UAV imagery and deep learning semantic segmentation

Road Segmentation in SAR Satellite Images with Deep Fully-Convolutional Neural Networks

An Overview of Deep Learning Techniques for Road Detection in High-Resolution Satellite Images

Automatic Extraction of Relevant Road Infrastructure using Connected vehicle data and Deep Learning Model

A Global Context-aware and Batch-independent Network for road extraction from VHR satellite imagery

Underwater Aerial Vehicle Networks Based Image Analysis By Deep Learning Architecture Integrated With 5G System

Road Extraction from Unmanned Aerial Vehicle Remote Sensing Images Based on Improved Neural Networks

TransRoadNet: A Novel Road Extraction Method for Remote Sensing Images via Combining High-Level Semantic Feature and Context

Road Extraction from Very-High-Resolution Remote Sensing Images via a Nested SE-Deeplab Model

Mixer U-Net: An Improved Automatic Road Extraction from UAV Imagery

Improving Road Semantic Segmentation Using Generative Adversarial Network

A Deep Cross-Modal Fusion Network for Road Extraction With High-Resolution Imagery and LiDAR Data

Road Extraction from High-Resolution Remote Sensing Images via Local and Global Context Reasoning

Road Network Extraction Using Multi-path Cascade Convolution Neural Network from Remote Sensing Images

A Lightweight High-Resolution RS Image Road Extraction Method Combining Multi-Scale and Attention Mechanism