Abstract:Unmanned Aerial Vehicle (UAV) aerial sensors are an important means of collecting ground image data. Through the road segmentation and vehicle detection of drivable areas in UAV aerial images, they can be applied to monitoring roads, traffic flow detection, traffic management, etc. As well, they can be integrated with intelligent transportation systems to support the related work of transportation departments. Existing algorithms only realize a single task, while intelligent transportation requires the simultaneous processing of multiple tasks, which cannot meet complex practical needs. However, UAV aerial images have the characteristics of variable road scenes, a large number of small targets, and dense vehicles, which make it difficult to complete the tasks. In response to these issues, we propose to implement road segmentation and on-road vehicle detection tasks in the same framework for UAV aerial images, and we conduct experiments on a self-constructed dataset based on the DroneVehicle dataset. For road segmentation, we propose a new algorithm C-DeepLabV3+. The new algorithm introduces the coordinate attention (CA) module, which can obtain more accurate segmentation target location information and make the segmentation target edges more continuous. Also, the improved algorithm introduces the cascade feature fusion module to prevent the loss of detail information in road segmentation and to obtain better segmentation performance. For vehicle detection, we propose an improved algorithm S-YOLOv5 by adding a parameter-free lightweight attention module SimAM. Finally, the proposed road segmentation–vehicle detection framework is utilized to unite the C-DeepLabV3+ and S-YOLOv5 algorithms for the implementation of the serial tasks. The experimental results show that on the constructed ViDroneVehicle dataset, the C-DeepLabV3+ algorithm has an mPA value of 98.75% and an mIoU value of 97.53%, which can better segment the road area and solve the problem of occlusion. The mAP value of the S-YOLOv5 algorithm has an mAP value of 97.40%, which is more than YOLOv5's 96.95%, which effectively reduces the vehicle omission and false detection rates. By comparison, the results of both algorithms are superior to multiple state-of-the-art methods. The overall framework proposed in this paper has superior performance and is capable of realizing high-quality and high-precision road segmentation and vehicle detection from UAV aerial images.

A Lightweight Multiscale-Multiobject Deep Segmentation Architecture for UAV-Based Consumer Applications

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

DroneSegNet: Robust Aerial Semantic Segmentation for UAV-Based IoT Applications

Aerial-PASS: Panoramic Annular Scene Segmentation in Drone Videos

Lightweight Network Learning with Zero-Shot Neural Architecture Search for UAV Images

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

IoT Enabled Deep Learning Based Framework for Multiple Object Detection in Remote Sensing Images

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

A Lightweight CNN–Transformer Network With Laplacian Loss for Low-Altitude UAV Imagery Semantic Segmentation

Lightweight Detection Network Based on Sub-Pixel Convolution and Objectness-Aware Structure for UAV Images

ISDNet: AI-enabled Instance Segmentation of Aerial Scenes for Smart Cities

S3M: Semantic Segmentation Sparse Mapping for UAVs with RGB-D Camera

SEMANTIC SEGMENTATION OF UAV IMAGES BASED ON U-NET IN URBAN AREA

Efficient Object Detection Model for Real-Time UAV Applications

Lightweight Deep Learning Models for High-Precision Rice Seedling Segmentation from UAV-Based Multispectral Images

Semantic segmentation of oblique UAV video based on ConvLSTM in complex urban area

BFANet: Effective Segmentation Network for Low Altitude High-Resolution Urban Scene Image

Image Semantic Segmentation Method Based on Deep Learning in UAV Aerial Remote Sensing Image

UAVformer: A Composite Transformer Network for Urban Scene Segmentation of UAV Images

UVid-Net: Enhanced Semantic Segmentation of UAV Aerial Videos by Embedding Temporal Information

A Novel Network Framework on Simultaneous Road Segmentation and Vehicle Detection for UAV Aerial Traffic Images