Abstract:Unmanned Aerial Vehicle (UAV) aerial sensors are an important means of collecting ground image data. Through the road segmentation and vehicle detection of drivable areas in UAV aerial images, they can be applied to monitoring roads, traffic flow detection, traffic management, etc. As well, they can be integrated with intelligent transportation systems to support the related work of transportation departments. Existing algorithms only realize a single task, while intelligent transportation requires the simultaneous processing of multiple tasks, which cannot meet complex practical needs. However, UAV aerial images have the characteristics of variable road scenes, a large number of small targets, and dense vehicles, which make it difficult to complete the tasks. In response to these issues, we propose to implement road segmentation and on-road vehicle detection tasks in the same framework for UAV aerial images, and we conduct experiments on a self-constructed dataset based on the DroneVehicle dataset. For road segmentation, we propose a new algorithm C-DeepLabV3+. The new algorithm introduces the coordinate attention (CA) module, which can obtain more accurate segmentation target location information and make the segmentation target edges more continuous. Also, the improved algorithm introduces the cascade feature fusion module to prevent the loss of detail information in road segmentation and to obtain better segmentation performance. For vehicle detection, we propose an improved algorithm S-YOLOv5 by adding a parameter-free lightweight attention module SimAM. Finally, the proposed road segmentation–vehicle detection framework is utilized to unite the C-DeepLabV3+ and S-YOLOv5 algorithms for the implementation of the serial tasks. The experimental results show that on the constructed ViDroneVehicle dataset, the C-DeepLabV3+ algorithm has an mPA value of 98.75% and an mIoU value of 97.53%, which can better segment the road area and solve the problem of occlusion. The mAP value of the S-YOLOv5 algorithm has an mAP value of 97.40%, which is more than YOLOv5's 96.95%, which effectively reduces the vehicle omission and false detection rates. By comparison, the results of both algorithms are superior to multiple state-of-the-art methods. The overall framework proposed in this paper has superior performance and is capable of realizing high-quality and high-precision road segmentation and vehicle detection from UAV aerial images.

Discretization–Filtering–Reconstruction: Railway Detection in Images for Navigation of Inspection UAV

Image Processing Techniques for UAV Vision-Based River Floating Contaminant Detection

Computer Vision-Based Railway Viaduct Component Inspection Using Multi-task Multi-scale Deep Neural Network

Railway Intrusion Detection Based on Refined Spatial and Temporal Features for UAV Surveillance Scene

Fully Decoupled Residual ConvNet for Real-Time Railway Scene Parsing of UAV Aerial Images

A Real-Time Method for Railway Track Detection and 3D Fitting Based on Camera and LiDAR Fusion Sensing

UAVs in rail damage image diagnostics supported by deep-learning networks

TriRNet: Real-Time Rail Recognition Network for UAV-Based Railway Inspection

An Efficient Algorithm for Extracting Railway Tracks Based on Spatial-Channel Graph Convolutional Network and Deep Neural Residual Network

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Linear features segmentation from aerial images

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

Hybrid deep learning architecture for rail surface segmentation and surface defect detection

Extraction network of forests and lakes along the railway based on remote sensing images

A Novel Network Framework on Simultaneous Road Segmentation and Vehicle Detection for UAV Aerial Traffic Images

High precision rail surface obstacle detection algorithm based on 3D imaging LiDAR

Automatic railroad track components inspection using real‐time instance segmentation

LiDAR-Assisted UAV Stereo Vision Detection in Railway Freight Transport Measurement

A Novel High-Precision Railway Obstacle Detection Algorithm Based on 3D LiDAR

DV3+HED+: A DCNNs-based Framework to Monitor Temporary Works and ESAs in Railway Construction Project Using VHR Satellite Images

Intelligent Image-Based Railway Inspection System Using Deep Learning-Based Object Detection and Weber Contrast-Based Image Comparison