Abstract:Continuous and reliable estimation of navigation states is of paramount importance in ensuring the safe operation of intelligent vehicles. The conventional global navigation satellite system (GNSS)-Inertial-Visual navigation systems have demonstrated the capability to achieve locally accurate and globally drift-free pose estimation. However, challenges such as frequent satellite signal interference, limited visual features, and sudden sensor failures can severely degrade performance or even lead to complete system collapse when utilizing minimal sensor configurations. For this reason, we propose a novel and globally drift-free tightly coupled (TC) system that can integrate any number of GNSS, inertial measurement units (IMUs), and cameras to enable accurate and robust vehicle navigation. Specifically, a stacked state estimator centered on the IMU is designed to fuse information from all sensors at the raw measurement level. The pseudorange and carrier phase measurements from all GNSS terminals are directly correlated with the core IMU, ensuring accurate and fast positioning of the system in a global frame. The feature measurements from multiple independent cameras are also used to update the states by exploiting inter-epoch geometric constraints. In addition, the multiple homogeneous IMUs can not only further improve the state estimation of the system by imposing rigid constraints on the core IMU, but also switch over in time for smooth state estimation when the core IMU are faulty. We comprehensively evaluate the state estimation accuracy and robustness of the proposed approach through a series of in-vehicle experiments and simulation experiments in real urban scenarios. The results indicate that the proposed system can achieve 93.2% availability with a horizontal position error less than 0.5 m and 97.8% availability with a heading error less than 0.2 deg in typical urban environments, significantly outperforming both conventional and state-of-the-art approaches. Note to Practitioners —This study focuses on the tight integration of multiple homogeneous and heterogeneous sensors with the goal of addressing frequent interference and degradation challenges in wide-area vehicle navigation applications. We propose a general-purpose GNSS-Inertial-Visual tight coupled framework capable of integrating any number of GNSS, IMUs, and cameras at the raw measurement level. It maximizes the use of as much sensor information as possible to achieve accurate and robust state estimation and is resilient to anomalous measurements and sensor unavailability. This solution holds practical and effective for autonomous vehicles that are now commonly equipped with multiple sensors.

Adaptive Visual Inertial Geomagnetic Tightly Coupled Positioning System

Geomagnetism Aided Inertial Navigation System

Gps/Ins/Odometer/Dr Integrated Navigation System Aided With Vehicular Dynamic Characteristics For Autonomous Vehicle Application

A Parameter Self-Calibration Method for GNSS/INS Deeply Coupled Navigation Systems in Highly Dynamic Environments

Simulation of Geomagnetic/Inertial Integrated Navigation System

INS/magnetometer Integrated Positioning Based on Neural Network for Bridging Long-Time GPS Outages

An Improved Method of Geomagnetic Aided Inertial Navigation Algorithm with Gyro and Accelerometer Error Corrected Online

Design and Performance Validation of Tightly Coupled Magneto-Inertial Navigation System for Robust Outdoor Application

An Adaptive Orientation Estimation Method for Magnetic and Inertial Sensors in the Presence of Magnetic Disturbances

An Integrated Navigation Algorithm Based on Three-Axis Magnetometer and Gravity Measurement

Magnetic orientation system based on magnetometer, accelerometer and gyroscope

A Tight Coupling Algorithm for Strapdown Inertial Navigation System (SINS)/Global Positioning System (GPS) Adaptive Integrated Navigation Based on Variational Bayesian

Accurate and Capable GNSS-Inertial-Visual Vehicle Navigation Via Tightly Coupled Multiple Homogeneous Sensors

Graph-Based Adaptive Fusion of GNSS and VIO under Intermittent GNSS-Degraded Environment.

A NOVEL METHOD FOR FUSION OF GNSS AND VISUAL-INERTIAL-WHEEL ODOMETRY

Method for Improving the Heading Precision of Navigation System Using Magnetometer

IC-GVINS: A Robust, Real-Time, INS-Centric GNSS-Visual-Inertial Navigation System

Attitude-Independent Geomagnetic Navigation Using Onboard Complete Three-Axis Magnetometer Calibration

Improving Robustness of the MAV Yaw Angle Estimation for Low‐cost INS/GPS Integration Aided with Tri‐axial Magnetometer Calibrated by Rotating the Ellipsoid Model

GVINS: Tightly Coupled GNSS–Visual–Inertial Fusion for Smooth and Consistent State Estimation

A Robust Visual Inertial Navigation System Based on Low-cost Inertial Measurement Unit