Abstract:In order to realize the cooperative localization of multi-unmanned platforms in the GNSS-denied environment, this paper proposes a collaborative SLAM (simultaneous localization and mapping, SLAM) framework based on image feature point matching. Without GNSS, a single unmanned platform UGV and UAV (unmanned ground vehicle, UGV; unmanned aerial vehicle, UAV) equipped with vision and IMU (inertial measurement unit, IMU) sensors can exchange information through data communication to jointly build a three-dimensional visual point map, and determine the relative position of each other through visual-based position re- identification and PnP (Perspective-n-Points, PnP) methods. When any agent can receive reliable GNSS signals, GNSS positioning information will greatly improve the positioning accuracy without changing the positioning algorithm framework. In order to achieve this function, we designed a set of two-stage position estimation algorithms. In the first stage, we used the modified ORB-SLAM3 algorithm for position estimation by fusing visual and IMU information. In the second stage, we integrated GNSS positioning and cooperative positioning information using the factor graph optimization (FGO) algorithm. Our framework consists of an UGV as the central server node and three UAVs carried by the UGV, that will collaborate on space exploration missions. Finally, we simulated the influence of different visibility and lighting conditions on the framework function on the virtual simulation experiment platform built based on ROS (robot operating system, ROS) and Unity3D. The accuracy of the cooperative localization algorithm and the single platform localization algorithm was evaluated. In the two cases of GNSS-denied and GNSS-challenged, the error of co-location reduced by 15.5% and 19.7%, respectively, compared with single-platform independent positioning.

Multi-sensor Fusion Framework Based on GPS State Detection

A Robust Localization Approach Using Multi-Sensor Fusion

A Multi-Sensor Fusion Positioning Strategy for Intelligent Vehicles Using Global Pose Graph Optimization

A multi-sensor fusion positioning approach for indoor mobile robot using factor graph

Multi-Sensor Fusion Tomato Picking Robot Localization and Mapping Research

Accurate and Robust State Estimation via Fusion of Visual-Inertial-UWB with Time Synchronization

A Multi-Sensor Fusion Framework for Localization Using LiDAR, IMU and RGB-DCamera

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method

UAV Localization Algorithm Based on Factor Graph Optimization in Complex Scenes

GOMSF: Graph-Optimization Based Multi-Sensor Fusion for robust UAV Pose estimation

A Low-Cost and Robust Multi-Sensor Data Fusion Scheme for Heterogeneous Multi-Robot Cooperative Positioning in Indoor Environments

Position Estimation Method for Small Drones Based on the Fusion of Multisource, Multimodal Data and Digital Twins

MFO-Fusion: A Multi-Frame Residual-Based Factor Graph Optimization for GNSS/INS/LiDAR Fusion in Challenging GNSS Environments

Real-Time Onboard 3D State Estimation of an Unmanned Aerial Vehicle in Multi-Environments Using Multi-Sensor Data Fusion

GPS-IMU Sensor Fusion for Reliable Autonomous Vehicle Position Estimation

GNSS-INS-Dynamic Fusion with Robustness to Outliers Based on External Force State Estimation

Improved Multi-Sensor Fusion Positioning System Based on GNSS/LiDAR/Vision/IMU With Semi-Tight Coupling and Graph Optimization in GNSS Challenging Environments

An Aerial and Ground Multi-Agent Cooperative Location Framework in GNSS-Challenged Environments

Robust Multi-Sensor Fusion SLAM Based on Road Network and Reflectivity Enhancement

An Optimization-Based UWB-IMU Fusion Framework for UGV