Abstract:In autonomous driving, environmental perception technology often encounters challenges such as false positives, missed detections, and low accuracy, particularly in detecting small objects and complex scenarios. Existing algorithms frequently suffer from issues like feature redundancy, insufficient contextual interaction, and inadequate information fusion, making it difficult to perform multi-task detection and segmentation efficiently. To address these challenges, this paper proposes an end-to-end multi-task environmental perception model named YOLO-Mg, designed to simultaneously perform traffic object detection, lane line detection, and drivable area segmentation. First, a multi-stage gated aggregation network (MogaNet) is employed during the feature extraction process to enhance contextual interaction by improving diversity in the channel dimension, thereby compensating for the limitations of feed-forward neural networks in contextual understanding. Second, to further improve the model's accuracy in detecting objects of various scales, a restructured weighted bidirectional feature pyramid network (BiFPN) is introduced, optimizing cross-level information fusion and enabling the model to handle object detection at different scales more accurately. Finally, the model is equipped with one detection head and two segmentation heads to achieve efficient multi-task environmental perception, ensuring the simultaneous execution of multiple tasks. The experimental results on the BDD100K dataset demonstrate that the model achieves a mean average precision (mAP50) of 81.4% in object detection, an Intersection over Union (IoU) of 28.9% in lane detection, and a mean Intersection over Union (mIoU) of 92.6% in drivable area segmentation. The tests conducted in real-world scenarios show that the model performs effectively, significantly enhancing environmental perception in autonomous driving and laying a solid foundation for safer and more reliable autonomous driving systems.

Ehsinet: Efficient High-Order Spatial Interaction Multi-task Network for Adaptive Autonomous Driving Perception

A Multi-Task Network Based on Dual-Neck Structure for Autonomous Driving Perception

Flexible Neural Network for Fast and Accurate Road Scene Perception.

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

HybridNets: End-to-End Perception Network

Elastic Interaction Energy-Informed Real-Time Traffic Scene Perception

Epurate-Net: Efficient Progressive Uncertainty Refinement Analysis for Traffic Environment Urban Road Detection

Driving Scene Perception Network: Real-time Joint Detection, Depth Estimation and Semantic Segmentation

NDNet: Spacewise Multiscale Representation Learning via Neighbor Decoupling for Real-Time Driving Scene Parsing

E-DNet: An End-to-End Dual-Branch Network for Driver Steering Intention Detection

A Multi-Task Road Feature Extraction Network with Grouped Convolution and Attention Mechanisms

CenterPNets: A Multi-Task Shared Network for Traffic Perception

Multi-Task Environmental Perception Methods for Autonomous Driving

Mobip: a lightweight model for driving perception using MobileNet

Real-Time Monocular Joint Perception Network for Autonomous Driving

An NN-Based Double Parallel Longitudinal and Lateral Driving Strategy for Self-Driving Transport Vehicles in Structured Road Scenarios

VisionNet: A Drivable-space-based Interactive Motion Prediction Network for Autonomous Driving

DSNet for Real-Time Driving Scene Semantic Segmentation

YOLOMH: you only look once for multi-task driving perception with high efficiency

Multi-task Learning for Real-time Autonomous Driving Leveraging Task-adaptive Attention Generator