Abstract:Continuous and reliable estimation of navigation states is of paramount importance in ensuring the safe operation of intelligent vehicles. The conventional global navigation satellite system (GNSS)-Inertial-Visual navigation systems have demonstrated the capability to achieve locally accurate and globally drift-free pose estimation. However, challenges such as frequent satellite signal interference, limited visual features, and sudden sensor failures can severely degrade performance or even lead to complete system collapse when utilizing minimal sensor configurations. For this reason, we propose a novel and globally drift-free tightly coupled (TC) system that can integrate any number of GNSS, inertial measurement units (IMUs), and cameras to enable accurate and robust vehicle navigation. Specifically, a stacked state estimator centered on the IMU is designed to fuse information from all sensors at the raw measurement level. The pseudorange and carrier phase measurements from all GNSS terminals are directly correlated with the core IMU, ensuring accurate and fast positioning of the system in a global frame. The feature measurements from multiple independent cameras are also used to update the states by exploiting inter-epoch geometric constraints. In addition, the multiple homogeneous IMUs can not only further improve the state estimation of the system by imposing rigid constraints on the core IMU, but also switch over in time for smooth state estimation when the core IMU are faulty. We comprehensively evaluate the state estimation accuracy and robustness of the proposed approach through a series of in-vehicle experiments and simulation experiments in real urban scenarios. The results indicate that the proposed system can achieve 93.2% availability with a horizontal position error less than 0.5 m and 97.8% availability with a heading error less than 0.2 deg in typical urban environments, significantly outperforming both conventional and state-of-the-art approaches. Note to Practitioners —This study focuses on the tight integration of multiple homogeneous and heterogeneous sensors with the goal of addressing frequent interference and degradation challenges in wide-area vehicle navigation applications. We propose a general-purpose GNSS-Inertial-Visual tight coupled framework capable of integrating any number of GNSS, IMUs, and cameras at the raw measurement level. It maximizes the use of as much sensor information as possible to achieve accurate and robust state estimation and is resilient to anomalous measurements and sensor unavailability. This solution holds practical and effective for autonomous vehicles that are now commonly equipped with multiple sensors.

Fault-Tolerant Multi-Sensor Fusion Positioning System for Autonomous Vehicles in Unknown Outdoor Environments

A Failure-Resistant, Lightweight, and Tightly Coupled GNSS/INS/Vision Vehicle Integration for Complex Urban Environments

Highly Robust and Accurate Multi-Sensor Fusion Localization System for Complex and Challenging Scenarios

Improved Multi-Sensor Fusion Positioning System Based on GNSS/LiDAR/Vision/IMU With Semi-Tight Coupling and Graph Optimization in GNSS Challenging Environments

A Multi-Sensor Fusion Positioning Strategy for Intelligent Vehicles Using Global Pose Graph Optimization

Tightly Coupled GNSS, INS and Visual Odometry for Accurate and Robust Vehicle Positioning

Confidence Field-Based Temporal Alignment and Positioning for Vehicles Using Multiple Sensors

Adaptive Multi-Sensor Fusion Localization Method Based on Filtering

A reliable multisensor fusion strategy for land vehicle positioning using low-cost sensors

Accurate and Capable GNSS-Inertial-Visual Vehicle Navigation Via Tightly Coupled Multiple Homogeneous Sensors

GNSS/IMU/LiDAR fusion for vehicle localization in urban driving environments within a consensus framework

An Effective Fusion Positioning Methodology for Land Vehicles in GPS-denied Environments Using Low-Cost Sensors

A Sensor Fusion Approach for Localization with Cumulative Error Elimination

Multi-sensor Fusion Methodology for Enhanced Land Vehicle Positioning

Radar-Based Multisensor Fusion for Uninterrupted Reliable Positioning in GNSS-Denied Environments

Kinematic and Dynamic Vehicle Model-Assisted Global Positioning Method for Autonomous Vehicles with Low-Cost GPS/Camera/In-Vehicle Sensors

Fusing GNSS/INS/Vision With A Priori Feature Map for High-Precision and Continuous Navigation

A Robust Vehicle Localization Approach Based on GNSS/IMU/DMI/LiDAR Sensor Fusion for Autonomous Vehicles

A Multi-Sensor Tight Fusion Method Designed for Vehicle Navigation

Improved Decentralized GNSS/SINS/odometer Fusion System for Land Vehicle Navigation Applications

A Reliable Cooperative Fusion Positioning Methodology for Intelligent Vehicle in Non-Line-of-Sight Environments