Abstract:The continuous, reliable, and accurate acquisition of position information is a fundamental requirement for autonomous vehicles. It underpins perception, decision-making, and planning modules in automated driving systems. However, the performance of multi-modal sensors, including the Global Navigation Satellite System (GNSS), Inertial Measurement Unit (IMU), and LiDAR, typically found in autonomous vehicles, is easily influenced by complex environmental factors encountered in urban driving conditions. This creates challenges for existing localization algorithms. More specifically, while GNSS performs accurately in open-sky areas, it is susceptible to the multi-path effect. Although the IMU-based Inertial Navigation System (INS) provides continuous position data, it suffers from cumulative errors. LiDAR-based map-matching is highly effective when sufficient point cloud features are present but fall short in plain environments. To address these individual sensor deficiencies, we propose the application of a consensus framework for GNSS/IMU/LiDAR fusion, and it is able to be expanded for multi-modal sensor fusion. Our approach seeks to take advantage of the redundancy inherent in these sensor systems. Our method begins with the derivation of the INS mechanization and its error dynamics. Subsequently, based on the Consensus Kalman Filter (CKF), we establish a GNSS measurement node and a Normal Distribution Transformation (NDT) map-matching measurement node. These are designed to estimate position errors in the INS. To counter sensor measurement failure or degradation, we introduce an adaptation mechanism for the CKF. This ensures position accuracy and continuity by normalizing measurement quality across different measurement nodes. Finally, to validate our consensus-based localization framework, we conducted extensive real-world vehicle tests in urban driving conditions. The results have confirmed the superior accuracy and robustness of our approach, even in the face of individual sensor failure. In our experiments, the proposed method reduces the localization mean absolute error by around 17% compared to INS/map-matching fusion, and around 59% compared to INS/GNSS fusion while map-matching fails. While the GNSS and map-matching measurements contain large noises, our framework achieves at least approximately a 30% improvement compared to traditional methods.

An Adaptive Multisensor Fusion for Intelligent Vehicle Localization

A Robust Localization Approach Using Multi-Sensor Fusion

UniMSF: A Unified Multi-Sensor Fusion Framework for Intelligent Transportation System Global Localization

Vehicle Localization on Semantic Map by Combining Visual and Distance Measurements

An Integrated LSTM-Rule-Based Fusion Method for the Localization of Intelligent Vehicles in a Complex Environment

Multi-Variate Data Fusion Technique for Reducing Sensor Errors in Intelligent Transportation Systems

Learning Visual Semantic Map-Matching for Loosely Multi-Sensor Fusion Localization of Autonomous Vehicles

A Multisensor Fusion With Automatic Vision–LiDAR Calibration Based on Factor Graph Joint Optimization for SLAM

Multi-Sensor Multi-Vehicle (MSMV) Localization and Mobility Tracking for Autonomous Driving

Multi-Sensor Fusion for Navigation and Mapping in Autonomous Vehicles: Accurate Localization in Urban Environments

GNSS/IMU/LiDAR fusion for vehicle localization in urban driving environments within a consensus framework

LVIO-SAM: A Multi-sensor Fusion Odometry via Smoothing and Mapping

MSFusion: Multilayer Sensor Fusion-Based Robust Motion Estimation

Multi-Sensor Fusion Tomato Picking Robot Localization and Mapping Research

A Robust Vehicle Localization Approach Based on GNSS/IMU/DMI/LiDAR Sensor Fusion for Autonomous Vehicles

Optimal Multi-Sensor Multi-Vehicle (MSMV) Localization and Mobility Tracking.

Multi-Sensor Fusion for Vehicle-to-Vehicle Cooperative Localization with Object Detection and Point Cloud Matching

FGO-MFI: Factor Graph Optimization-based Multi-sensor Fusion and Integration for Reliable Localization

Autonomous Driving Vehicles Using Adaptive Learning Method for Data Fusion

MetroLoc: Metro Vehicle Mapping and Localization with LiDAR-Camera-Inertial Integration

Research on Robust Detection System of Vehicle Attitude Fusion Features Based on Multi-Sensor Fusion