Abstract:In autonomous driving, environmental perception technology often encounters challenges such as false positives, missed detections, and low accuracy, particularly in detecting small objects and complex scenarios. Existing algorithms frequently suffer from issues like feature redundancy, insufficient contextual interaction, and inadequate information fusion, making it difficult to perform multi-task detection and segmentation efficiently. To address these challenges, this paper proposes an end-to-end multi-task environmental perception model named YOLO-Mg, designed to simultaneously perform traffic object detection, lane line detection, and drivable area segmentation. First, a multi-stage gated aggregation network (MogaNet) is employed during the feature extraction process to enhance contextual interaction by improving diversity in the channel dimension, thereby compensating for the limitations of feed-forward neural networks in contextual understanding. Second, to further improve the model's accuracy in detecting objects of various scales, a restructured weighted bidirectional feature pyramid network (BiFPN) is introduced, optimizing cross-level information fusion and enabling the model to handle object detection at different scales more accurately. Finally, the model is equipped with one detection head and two segmentation heads to achieve efficient multi-task environmental perception, ensuring the simultaneous execution of multiple tasks. The experimental results on the BDD100K dataset demonstrate that the model achieves a mean average precision (mAP50) of 81.4% in object detection, an Intersection over Union (IoU) of 28.9% in lane detection, and a mean Intersection over Union (mIoU) of 92.6% in drivable area segmentation. The tests conducted in real-world scenarios show that the model performs effectively, significantly enhancing environmental perception in autonomous driving and laying a solid foundation for safer and more reliable autonomous driving systems.

Environment Perception Framework Fusing Multi-Object Tracking, Dynamic Occupancy Grid Maps and Digital Maps

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Fusion of Object Tracking and Dynamic Occupancy Grid Map

Situation-Aware Environment Perception Using a Multi-Layer Attention Map

Collaborative Grid Mapping for Moving Object Tracking Evaluation

Combined Image- and World-Space Tracking in Traffic Scenes

Multi-Sensor Data Fusion for Real-Time Multi-Object Tracking

Detection-level Fusion for Multi-Object Perception in Dense Traffic Environment

Multi-Lane Perception Using Feature Fusion Based on GraphSLAM

Multi-Task Environmental Perception Methods for Autonomous Driving

Reducing Uncertainty by Fusing Dynamic Occupancy Grid Maps in a Cloud-based Collective Environment Model

Perception Helps Planning: Facilitating Multi-Stage Lane-Level Integration via Double-Edge Structures

Perceptual Factors for Environmental Modeling in Robotic Active Perception

InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensors

Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensors

Autonomous Multi-Sensor Fusion Techniques for Environmental Perception in Self-Driving Vehicles

Identification of Threat Regions From a Dynamic Occupancy Grid Map for Situation-Aware Environment Perception

Enhancing 3D object detection through multi-modal fusion for cooperative perception

3D object detection and state estimation method based on stereo vision and LIDAR fusion

Multi-Modal Sensor Fusion and Object Tracking for Autonomous Racing

Enhanced Perception for Autonomous Driving Using Semantic and Geometric Data Fusion