Abstract:Automatic road extraction from unmanned aerial vehicle (UAV) imagery has been one of the major research topics in the area of remote sensing analysis due to its importance in a wide range of applications such as urban planning, road monitoring, intelligent transportation systems, and automatic road navigation. Thanks to the recent advances in Deep Learning (DL), the tedious manual segmentation of roads can be automated. However, the majority of these models are computationally heavy and, thus, are not suitable for UAV remote-sensing tasks with limited resources. To alleviate this bottleneck, we propose two lightweight models based on depthwise separable convolutions and ConvMixer inception block. Both models take the advantage of computational efficiency of depthwise separable convolutions and multi-scale processing of inception module and combine them in an encoder–decoder architecture of U-Net. Specifically, we substitute standard convolution layers used in U-Net for ConvMixer layers. Furthermore, in order to learn images on different scales, we apply ConvMixer layer into Inception module. Finally, we incorporate pathway networks along the skip connections to minimize the semantic gap between encoder and decoder. In order to validate the performance and effectiveness of the models, we adopt Massachusetts roads dataset. One incarnation of our models is able to beat the U-Net’s performance with 10× fewer parameters, and DeepLabV3’s performance with 12× fewer parameters in terms of mean intersection over union (mIoU) metric. For further validation, we have compared our models against four baselines in total and used additional metrics such as precision (P), recall (R), and F1 score.

Utilizing UNet for the future traffic map prediction task Traffic4cast challenge 2020

Traffic map prediction using UNet based deep convolutional neural network

Traffic4cast -- Large-scale Traffic Prediction using 3DResNet and Sparse-UNet

GPS-based Citywide Traffic Congestion Forecasting Using CNN-RNN and C3D Hybrid Model

Towards Good Practices of U-Net for Traffic Forecasting

Multi-Purpose, Multi-Step Deep Learning Framework for Network-Level Traffic Flow Prediction

GSTC-Unet: A U-shaped multi-scaled spatiotemporal graph convolutional network with channel self-attention mechanism for traffic flow forecasting

Mixer U-Net: An Improved Automatic Road Extraction from UAV Imagery

A Graph-based U-Net Model for Predicting Traffic in unseen Cities

SDUNet: Road extraction via spatial enhanced and densely connected UNet

Efficient spatio-temporal weather forecasting using U-Net

TLab: Second Place Solution Towards Traffic4cast 2020 Competition

TLab: Traffic Map Movie Forecasting Based on HR-NET

Large-Scale Road Network Traffic Congestion Prediction Based on Recurrent High-Resolution Network

Building Effective Large-Scale Traffic State Prediction System: Traffic4cast Challenge Solution

Deep Autoencoder Neural Networks for Short-Term Traffic Congestion Prediction of Transportation Networks

Transposed Variational Auto-encoder with Intrinsic Feature Learning for Traffic Forecasting

City-Wide Traffic Congestion Prediction Based on CNN, LSTM and Transpose CNN

Traffic flow prediction using Deep Sedenion Networks

AST3DRNet: Attention-Based Spatio-Temporal 3D Residual Neural Networks for Traffic Congestion Prediction

Attention Gate in Traffic Forecasting