Abstract:In autonomous driving, environmental perception technology often encounters challenges such as false positives, missed detections, and low accuracy, particularly in detecting small objects and complex scenarios. Existing algorithms frequently suffer from issues like feature redundancy, insufficient contextual interaction, and inadequate information fusion, making it difficult to perform multi-task detection and segmentation efficiently. To address these challenges, this paper proposes an end-to-end multi-task environmental perception model named YOLO-Mg, designed to simultaneously perform traffic object detection, lane line detection, and drivable area segmentation. First, a multi-stage gated aggregation network (MogaNet) is employed during the feature extraction process to enhance contextual interaction by improving diversity in the channel dimension, thereby compensating for the limitations of feed-forward neural networks in contextual understanding. Second, to further improve the model's accuracy in detecting objects of various scales, a restructured weighted bidirectional feature pyramid network (BiFPN) is introduced, optimizing cross-level information fusion and enabling the model to handle object detection at different scales more accurately. Finally, the model is equipped with one detection head and two segmentation heads to achieve efficient multi-task environmental perception, ensuring the simultaneous execution of multiple tasks. The experimental results on the BDD100K dataset demonstrate that the model achieves a mean average precision (mAP50) of 81.4% in object detection, an Intersection over Union (IoU) of 28.9% in lane detection, and a mean Intersection over Union (mIoU) of 92.6% in drivable area segmentation. The tests conducted in real-world scenarios show that the model performs effectively, significantly enhancing environmental perception in autonomous driving and laying a solid foundation for safer and more reliable autonomous driving systems.

Real-Time Multi-Task Environmental Perception System for Traffic Safety Empowered by Edge Artificial Intelligence

Vehicular Edge Computing for Multi-Vehicle Perception

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

AyE-Edge: Automated Deployment Space Search Empowering Accuracy Yet Efficient Real-Time Object Detection on the Edge

Cooperative and Comprehensive Multi-Task Surveillance Sensing and Interaction System Empowered by Edge Artificial Intelligence

Multi-Task Environmental Perception Methods for Autonomous Driving

Traffic-Informed Multi-Camera Sensing (TIMS) System Based on Vehicle Re-Identification

MSight: An Edge-Cloud Infrastructure-based Perception System for Connected Automated Vehicles

Roadside Unit-based Unknown Object Detection in Adverse Weather Conditions for Smart Internet of Vehicles

Smart Traffic Monitoring System Using Computer Vision and Edge Computing

Design, Implementation, and Evaluation of a Roadside Cooperative Perception System

Epurate-Net: Efficient Progressive Uncertainty Refinement Analysis for Traffic Environment Urban Road Detection

Collaborative processing and data optimization of environmental perception technologies for autonomous vehicles

Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras

CAV driving safety monitoring and warning via V2X-based edge computing system

Edge Computing-Enabled Road Condition Monitoring: System Development and Evaluation

An Edge Assisted Robust Smart Traffic Management and Signalling System for Guiding Emergency Vehicles During Peak Hours

Towards an Edge Intelligence-Based Traffic Monitoring System

Edge Computing for Real-Time Near-Crash Detection for Smart Transportation Applications

Edge Intelligence Empowered Urban Traffic Monitoring: A Network Tomography Perspective