Abstract:In autonomous driving, environmental perception technology often encounters challenges such as false positives, missed detections, and low accuracy, particularly in detecting small objects and complex scenarios. Existing algorithms frequently suffer from issues like feature redundancy, insufficient contextual interaction, and inadequate information fusion, making it difficult to perform multi-task detection and segmentation efficiently. To address these challenges, this paper proposes an end-to-end multi-task environmental perception model named YOLO-Mg, designed to simultaneously perform traffic object detection, lane line detection, and drivable area segmentation. First, a multi-stage gated aggregation network (MogaNet) is employed during the feature extraction process to enhance contextual interaction by improving diversity in the channel dimension, thereby compensating for the limitations of feed-forward neural networks in contextual understanding. Second, to further improve the model's accuracy in detecting objects of various scales, a restructured weighted bidirectional feature pyramid network (BiFPN) is introduced, optimizing cross-level information fusion and enabling the model to handle object detection at different scales more accurately. Finally, the model is equipped with one detection head and two segmentation heads to achieve efficient multi-task environmental perception, ensuring the simultaneous execution of multiple tasks. The experimental results on the BDD100K dataset demonstrate that the model achieves a mean average precision (mAP50) of 81.4% in object detection, an Intersection over Union (IoU) of 28.9% in lane detection, and a mean Intersection over Union (mIoU) of 92.6% in drivable area segmentation. The tests conducted in real-world scenarios show that the model performs effectively, significantly enhancing environmental perception in autonomous driving and laying a solid foundation for safer and more reliable autonomous driving systems.

Multi-task Panoramic Driving Perception Algorithm Based on Improved YOLOv5

A panoramic driving perception fusion algorithm based on multi-task learning

YOLOMH: you only look once for multi-task driving perception with high efficiency

Research on Autonomous Driving Image Recognition Based on a New Real-Time Object Detection Model YOLOv5st

Improving Unmanned Panoramic Perception Algorithm of DAFPN-YOLO

YOLOP: You Only Look Once for Panoptic Driving Perception

Multi-Task Visual Perception for Object Detection and Semantic Segmentation in Intelligent Driving

Multi-Task Environmental Perception Methods for Autonomous Driving

You Only Look at Once for Real-time and Generic Multi-Task

Research on Road Scene Understanding of Autonomous Vehicles Based on Multi-Task Learning

Q-YOLOP: Quantization-aware You Only Look Once for Panoptic Driving Perception

A Multi-Scale Vehicle Detection Method for Highways Based on YOLOv5

A Multi-Task Network Based on Dual-Neck Structure for Autonomous Driving Perception

PAHD-YOLOv5:Parallel Attention and Hybrid Dilated Convolution for Autonomous Driving Object Detection

Environmental Perception Algorithm for Multi-Target Autonomous Driving Based on YOLOv7-CBAM

Road Scene Multi-Object Detection Algorithm Based on CMS-YOLO

Research on Multi-Task Perception Network of Traffic Scene Based on Feature Fusion1

Driverless Image Processing Based on Improved YOLOv5l

LBT-YOLO: A Lightweight Road Targeting Algorithm Based on Task Aligned Dynamic Detection Heads

High-precision real-time autonomous driving target detection based on YOLOv8

YOLOv4-5D: An Effective and Efficient Object Detector for Autonomous Driving