Abstract:Continuous and reliable estimation of navigation states is of paramount importance in ensuring the safe operation of intelligent vehicles. The conventional global navigation satellite system (GNSS)-Inertial-Visual navigation systems have demonstrated the capability to achieve locally accurate and globally drift-free pose estimation. However, challenges such as frequent satellite signal interference, limited visual features, and sudden sensor failures can severely degrade performance or even lead to complete system collapse when utilizing minimal sensor configurations. For this reason, we propose a novel and globally drift-free tightly coupled (TC) system that can integrate any number of GNSS, inertial measurement units (IMUs), and cameras to enable accurate and robust vehicle navigation. Specifically, a stacked state estimator centered on the IMU is designed to fuse information from all sensors at the raw measurement level. The pseudorange and carrier phase measurements from all GNSS terminals are directly correlated with the core IMU, ensuring accurate and fast positioning of the system in a global frame. The feature measurements from multiple independent cameras are also used to update the states by exploiting inter-epoch geometric constraints. In addition, the multiple homogeneous IMUs can not only further improve the state estimation of the system by imposing rigid constraints on the core IMU, but also switch over in time for smooth state estimation when the core IMU are faulty. We comprehensively evaluate the state estimation accuracy and robustness of the proposed approach through a series of in-vehicle experiments and simulation experiments in real urban scenarios. The results indicate that the proposed system can achieve 93.2% availability with a horizontal position error less than 0.5 m and 97.8% availability with a heading error less than 0.2 deg in typical urban environments, significantly outperforming both conventional and state-of-the-art approaches. Note to Practitioners —This study focuses on the tight integration of multiple homogeneous and heterogeneous sensors with the goal of addressing frequent interference and degradation challenges in wide-area vehicle navigation applications. We propose a general-purpose GNSS-Inertial-Visual tight coupled framework capable of integrating any number of GNSS, IMUs, and cameras at the raw measurement level. It maximizes the use of as much sensor information as possible to achieve accurate and robust state estimation and is resilient to anomalous measurements and sensor unavailability. This solution holds practical and effective for autonomous vehicles that are now commonly equipped with multiple sensors.

Confidence Field-Based Temporal Alignment and Positioning for Vehicles Using Multiple Sensors

A reliable multisensor fusion strategy for land vehicle positioning using low-cost sensors

Fault-Tolerant Multi-Sensor Fusion Positioning System for Autonomous Vehicles in Unknown Outdoor Environments

Adaptive Multi-Sensor Fusion Localization Method Based on Filtering

A Hybrid Intelligent Multisensor Positioning Methodology for Reliable Vehicle Navigation

A Multi-Sensor Tight Fusion Method Designed for Vehicle Navigation

A Reliable Cooperative Fusion Positioning Methodology for Intelligent Vehicle in Non-Line-of-Sight Environments

A Sensor Fusion Approach for Localization with Cumulative Error Elimination

A Reliable Fusion Positioning Strategy for Land Vehicles in GPS-Denied Environments Based on Low-Cost Sensors

Tightly Coupled GNSS, INS and Visual Odometry for Accurate and Robust Vehicle Positioning

An Effective Fusion Positioning Methodology for Land Vehicles in GPS-denied Environments Using Low-Cost Sensors

Vehicle Global Positioning Based on Sensor Fusion

Improved Decentralized GNSS/SINS/odometer Fusion System for Land Vehicle Navigation Applications

A Hybrid Positioning Strategy for Vehicles in a Tunnel Based on RFID and In-Vehicle Sensors

Integrated navigation accuracy improvement algorithm based on multi-sensor fusion

A Multi-Sensor Fusion Positioning Strategy for Intelligent Vehicles Using Global Pose Graph Optimization

Multi-sensor Fusion Methodology for Enhanced Land Vehicle Positioning

Adaptive Filtering and Temporal Alignment Based Fusion Algorithm for Navigation Systems in the Arctic Region

A Failure-Resistant, Lightweight, and Tightly Coupled GNSS/INS/Vision Vehicle Integration for Complex Urban Environments

Accurate and Capable GNSS-Inertial-Visual Vehicle Navigation Via Tightly Coupled Multiple Homogeneous Sensors

Research on Unmanned Vehicle Positioning Technology Based on Multi-sensor Fusion