Abstract:Unmanned Aerial Vehicle (UAV) aerial sensors are an important means of collecting ground image data. Through the road segmentation and vehicle detection of drivable areas in UAV aerial images, they can be applied to monitoring roads, traffic flow detection, traffic management, etc. As well, they can be integrated with intelligent transportation systems to support the related work of transportation departments. Existing algorithms only realize a single task, while intelligent transportation requires the simultaneous processing of multiple tasks, which cannot meet complex practical needs. However, UAV aerial images have the characteristics of variable road scenes, a large number of small targets, and dense vehicles, which make it difficult to complete the tasks. In response to these issues, we propose to implement road segmentation and on-road vehicle detection tasks in the same framework for UAV aerial images, and we conduct experiments on a self-constructed dataset based on the DroneVehicle dataset. For road segmentation, we propose a new algorithm C-DeepLabV3+. The new algorithm introduces the coordinate attention (CA) module, which can obtain more accurate segmentation target location information and make the segmentation target edges more continuous. Also, the improved algorithm introduces the cascade feature fusion module to prevent the loss of detail information in road segmentation and to obtain better segmentation performance. For vehicle detection, we propose an improved algorithm S-YOLOv5 by adding a parameter-free lightweight attention module SimAM. Finally, the proposed road segmentation–vehicle detection framework is utilized to unite the C-DeepLabV3+ and S-YOLOv5 algorithms for the implementation of the serial tasks. The experimental results show that on the constructed ViDroneVehicle dataset, the C-DeepLabV3+ algorithm has an mPA value of 98.75% and an mIoU value of 97.53%, which can better segment the road area and solve the problem of occlusion. The mAP value of the S-YOLOv5 algorithm has an mAP value of 97.40%, which is more than YOLOv5's 96.95%, which effectively reduces the vehicle omission and false detection rates. By comparison, the results of both algorithms are superior to multiple state-of-the-art methods. The overall framework proposed in this paper has superior performance and is capable of realizing high-quality and high-precision road segmentation and vehicle detection from UAV aerial images.

Intelligent Mining Road Object Detection Based on Multiscale Feature Fusion in Multi-UAV Networks

A New Network Model for Multiple Object Detection for Autonomous Vehicle Detection in Mining Environment

A Real-Time Negative Obstacle Detection Method for Autonomous Trucks in Open-Pit Mines

MineSDS: A Unified Framework for Small Object Detection and Drivable Area Segmentation for Open-Pit Mining Scenario

A Multi-Sensor Fusion Autonomous Driving Localization System for Mining Environments

An Intelligent Obstacle Detection for Autonomous Mining Transportation with Electric Locomotive Via Cellular Vehicle-to-Everything and Vehicular Edge Computing

High-Precision Positioning, Perception and Safe Navigation for Automated Heavy-duty Mining Trucks

A Detection and Tracking Method Based on Heterogeneous Multi-Sensor Fusion for Unmanned Mining Trucks

Accurate real-time obstacle detection of coal mine driverless electric locomotive based on ODEL-YOLOv5s

Extracting unstructured roads for smart Open-Pit mines based on computer vision: Implications for intelligent mining

V2X, GNSS, radar, and camera-based intelligent system for adaptive control of heavy mining vehicles during foggy weather

YOLO-U: multi-task model for vehicle detection and road segmentation in UAV aerial imagery

Object detection model of coal mine rescue robot based on multi-scale feature fusion

Parallel Perception of Autonomous Vehicle in Degraded Coal Mines

A High-Precision Road Network Construction Method Based on Deep Learning for Unmanned Vehicle in Open Pit

MineDet: A Real-Time Object Detection Framework Based Neural Architecture Search for Coal Mines

Autonomous Positioning for Mobile Vehicles Based on Visual-Inertial Fusion in Challenging Dark Roadway Scenes

Multi-scale feature fusion with attention mechanism for crowded road object detection

3D Vehicle Detection with RSU LiDAR for Autonomous Mine.

Autonomous Mining Transportation Systems: Integrating 4D Mmwave Radar for Enhanced Detection of Obstructed Static Objects

A Novel Network Framework on Simultaneous Road Segmentation and Vehicle Detection for UAV Aerial Traffic Images