Abstract:Continuous and reliable estimation of navigation states is of paramount importance in ensuring the safe operation of intelligent vehicles. The conventional global navigation satellite system (GNSS)-Inertial-Visual navigation systems have demonstrated the capability to achieve locally accurate and globally drift-free pose estimation. However, challenges such as frequent satellite signal interference, limited visual features, and sudden sensor failures can severely degrade performance or even lead to complete system collapse when utilizing minimal sensor configurations. For this reason, we propose a novel and globally drift-free tightly coupled (TC) system that can integrate any number of GNSS, inertial measurement units (IMUs), and cameras to enable accurate and robust vehicle navigation. Specifically, a stacked state estimator centered on the IMU is designed to fuse information from all sensors at the raw measurement level. The pseudorange and carrier phase measurements from all GNSS terminals are directly correlated with the core IMU, ensuring accurate and fast positioning of the system in a global frame. The feature measurements from multiple independent cameras are also used to update the states by exploiting inter-epoch geometric constraints. In addition, the multiple homogeneous IMUs can not only further improve the state estimation of the system by imposing rigid constraints on the core IMU, but also switch over in time for smooth state estimation when the core IMU are faulty. We comprehensively evaluate the state estimation accuracy and robustness of the proposed approach through a series of in-vehicle experiments and simulation experiments in real urban scenarios. The results indicate that the proposed system can achieve 93.2% availability with a horizontal position error less than 0.5 m and 97.8% availability with a heading error less than 0.2 deg in typical urban environments, significantly outperforming both conventional and state-of-the-art approaches. Note to Practitioners —This study focuses on the tight integration of multiple homogeneous and heterogeneous sensors with the goal of addressing frequent interference and degradation challenges in wide-area vehicle navigation applications. We propose a general-purpose GNSS-Inertial-Visual tight coupled framework capable of integrating any number of GNSS, IMUs, and cameras at the raw measurement level. It maximizes the use of as much sensor information as possible to achieve accurate and robust state estimation and is resilient to anomalous measurements and sensor unavailability. This solution holds practical and effective for autonomous vehicles that are now commonly equipped with multiple sensors.

Tight Fusion of a Monocular Camera, MEMS-IMU, and Single-Frequency Multi-GNSS RTK for Precise Navigation in GNSS-Challenged Environments

Tightly-Coupled Integration of Multi-GNSS Single-Frequency RTK and MEMS-IMU for Enhanced Positioning Performance

Continuous and Precise Positioning in Urban Environments by Tightly Coupled Integration of GNSS, INS and Vision

TIGHTLY-COUPLED RTK/INS INTEGRATED NAVIGATION USING A LOW-COST GNSS RECEIVER AND A MEMS IMU

Centimeter-accurate vehicle navigation in urban environments with a tightly integrated PPP-RTK/MEMS/vision system

Accurate and Capable GNSS-Inertial-Visual Vehicle Navigation Via Tightly Coupled Multiple Homogeneous Sensors

Robust IMU/GPS/VO Integration for Vehicle Navigation in GNSS Degraded Urban Areas

Multi-GNSS PPP/INS/Vision/LiDAR tightly integrated system for precise navigation in urban environments

Tightly Coupled GNSS, INS and Visual Odometry for Accurate and Robust Vehicle Positioning

A Robust Fusion Methodology for MEMS-Based Land Vehicle Navigation in GNSS-Challenged Environments

High-Accuracy Positioning in GNSS-Blocked Areas by Using the MSCKF-Based SF-RTK/IMU/Camera Tight Integration

High-Accuracy Positioning in Urban Environments Using Single-Frequency Multi-GNSS RTK/MEMS-IMU Integration

A Filter-Based Integration of GNSS, INS, and Stereo Vision in Tight Mode with Optimal Smoothing

A High-Precision Vehicle Navigation System Based on Tightly Coupled PPP-RTK/INS/Odometer Integration

IMU-Based Automated Vehicle Body Sideslip Angle and Attitude Estimation Aided by GNSS Using Parallel Adaptive Kalman Filters

Cubature Kalman Filter with Both Adaptability and Robustness for Tightly-Coupled GNSS/INS Integration

Evaluation on Low-cost GNSS/IMU/Vision Integration System in GNSS-denied Environments.

Advancing High-Precision Navigation: Leveraging Homogeneous Sensors in Tightly Coupled PPP-RTK/IMU Integration

Multi-sensor Fusion Methodology for Enhanced Land Vehicle Positioning

Tightly coupled integration of vector HD map, LiDAR, GNSS, and INS for precise vehicle navigation in GNSS-challenging environment

Fusing Stereo Camera and Low-Cost Inertial Measurement Unit for Autonomous Navigation in A Tightly-Coupled Approach