Abstract:Accurate vehicle pose is fundamental information required by automated driving systems. However, complicated driving environments and sensor failures have constrained onboard sensor-based single-vehicle localization precision. With the development of cooperative driving automation, the information from surrounding vehicles in the Vehicle-to-Everything (V2V) network offers remarkable potential to boost the ego vehicle’s localization performance. In this paper, we propose a cooperative vehicle localization framework based on multi-sensor fusion that uses shared information from multi-agents, leveraging point cloud feature matching and object detection. The ego vehicle’s detection system can determine the relative pose between the ego vehicle and the corresponding surrounding vehicles based on data from the LiDAR sensor. However, the accuracy of the pose information derived directly from deep-learning-based object detection is limited. Thus, a relative pose refining method is proposed to further improve the relative pose by applying a point cloud matching technique based on a normal distribution transformation approach. Meanwhile, to reduce the data transmission load, we extract only the edge and plane features from the surrounding vehicle’s LiDAR scan and exclude the remaining point cloud. Additionally, the shared information is fused into the ego vehicle’s INS-based localization system, which enables continuous and high-frequency localization output within a Kalman filter framework. To make the fusion algorithm more adaptive to different relative pose noise levels, a measurement quality evaluation rule is designed. Real-world vehicular experiments show that the proposed algorithm can improve localization accuracy by at least 35% compared to the traditional range-based cooperative localization method.

Occupancy Grid Map Formation and Fusion in Cooperative Autonomous Vehicle Sensing (invited Paper)

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Multivehicle Multisensor Occupancy Grid Maps (MVMS-OGM) for Autonomous Driving

A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspective

Cooperative Intelligence for Autonomous Driving

Multi-Sensor Fusion Tomato Picking Robot Localization and Mapping Research

Edge Computing-Based Collaborative Vehicles 3D Mapping in Real Time

Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehicles

Dynamic Occupancy Grid Map with Semantic Information Using Deep Learning-Based BEVFusion Method with Camera and LiDAR Fusion

Three-Dimensional Cooperative Mapping for Connected and Automated Vehicles

CoFF: Cooperative Spatial Feature Fusion for 3D Object Detection on Autonomous Vehicles

Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Clouds

Map Container: A Map-based Framework for Cooperative Perception

Reducing Uncertainty by Fusing Dynamic Occupancy Grid Maps in a Cloud-based Collective Environment Model

Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Driving

Semi-Interpenetrating Cooperative Localization in Connected Vehicle Networks

Multi-sensor fusion algorithm in cooperative vehicle-infrastructure system for blind spot warning

A Novel Probabilistic V2X Data Fusion Framework for Cooperative Perception

Improving Autonomous Vehicle Mapping and Navigation in Work Zones Using Crowdsourcing Vehicle Trajectories

Multi-Sensor Fusion and Cooperative Perception for Autonomous Driving: A Review

Multi-Sensor Fusion for Vehicle-to-Vehicle Cooperative Localization with Object Detection and Point Cloud Matching