Abstract:Urban road extraction is important for the applications of urban planning and transportation. High-resolution image (HRI) has been one of the most popular data sources for extracting roads with high efficiency and low cost. However, roads in HRI are easily obscured by buildings, trees, and other landscapes, resulting in discontinuity of the extracted roads. While current road extraction techniques by multimodal data fusion have shown improved results compared to single-modal methods by incorporating additional information, most existing fusion methods fail to fully exploit the features from different modalities and consider prior knowledge of roads. To address the above problems, a dual encoder-based cross-modal complementary fusion network (DECCFNet) is proposed in this article. The proposed network takes full advantage of the rich feature information contained in HRI and the immunity of LiDAR data to the influence of shadows. By effectively fusing the complementary information from HRI and LiDAR data, DECCFNet, respectively, achieved an improvement by at least 2.94% and 2.8% in IOU compared to those only using a single data modality on the two datasets. The proposed DECCFNet mainly contains two modules: 1) cross-modal feature fusion (CMFF) module: in the dual encoder part, CMFF is employed to fuse the deep features of different modalities from the channel and spatial dimension, while a multiscale fusion strategy is utilized to extract the contextual information; 2) multi-direction strip convolution (MDSC) module: since roads have the characteristics of narrowness and continuity, adopting classical convolution kernels directly on road features may introduce irrelevant pixels into the computation, blurring the extraction results. To mitigate this issue, MDSC is applied to strip the convolution of road features from multiple directions based on square convolution and make the network focus more on the specific road features. By comparing several deep-learning multimodal data fusion networks in the two road datasets, the proposed network exhibits the best road extraction results.

Deep Fusion for Travel Time Estimation Based on Road Network Topology

Learning Spatial-Temporal Features of Ride-Hailing Services with Fusion Convolutional Networks

Deep Architecture for Citywide Travel Time Estimation Incorporating Contextual Information

A Deep Cross-Modal Fusion Network for Road Extraction With High-Resolution Imagery and LiDAR Data

Route Travel Time Estimation on a Road Network Revisited

Fine-Grained Traffic Flow Prediction of Various Vehicle Types via Fusion of Multisource Data and Deep Learning Approaches

DeepTravel: a Neural Network Based Travel Time Estimation Model with Auxiliary Supervision

Route Travel Time Estimation on A Road Network Revisited: Heterogeneity, Proximity, Periodicity and Dynamicity

Hybrid Deep Learning Approach For Urban Expressway Travel Time Prediction Considering Spatial-Temporal Features

When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks

A duplex transform heterogeneous feature fusion network for road segmentation

Trip destination prediction based on a deep integration network by fusing multiple features from taxi trajectories

Aggressive Driving Saves More Time? Multi-task Learning for Customized Travel Time Estimation

Road Traffic Operation Assessment Based on Multi-source Floating Car Data Fusion

Traffic density estimation via a multi-level feature fusion network

Traffic speed prediction for intelligent transportation system based on a deep feature fusion model

Spatiotemporal Features—Extracted Travel Time Prediction Leveraging Deep-Learning-Enabled Graph Convolutional Neural Network Model

Bus Dynamic Travel Time Prediction: Using a Deep Feature Extraction Framework Based on RNN and DNN

Urban Ride-Hailing Demand Prediction with Multiple Spatiotemporal Information Fusion Network

Effective Travel Time Estimation: when Historical Trajectories over Road Networks Matter.