Abstract:In order to realize the cooperative localization of multi-unmanned platforms in the GNSS-denied environment, this paper proposes a collaborative SLAM (simultaneous localization and mapping, SLAM) framework based on image feature point matching. Without GNSS, a single unmanned platform UGV and UAV (unmanned ground vehicle, UGV; unmanned aerial vehicle, UAV) equipped with vision and IMU (inertial measurement unit, IMU) sensors can exchange information through data communication to jointly build a three-dimensional visual point map, and determine the relative position of each other through visual-based position re- identification and PnP (Perspective-n-Points, PnP) methods. When any agent can receive reliable GNSS signals, GNSS positioning information will greatly improve the positioning accuracy without changing the positioning algorithm framework. In order to achieve this function, we designed a set of two-stage position estimation algorithms. In the first stage, we used the modified ORB-SLAM3 algorithm for position estimation by fusing visual and IMU information. In the second stage, we integrated GNSS positioning and cooperative positioning information using the factor graph optimization (FGO) algorithm. Our framework consists of an UGV as the central server node and three UAVs carried by the UGV, that will collaborate on space exploration missions. Finally, we simulated the influence of different visibility and lighting conditions on the framework function on the virtual simulation experiment platform built based on ROS (robot operating system, ROS) and Unity3D. The accuracy of the cooperative localization algorithm and the single platform localization algorithm was evaluated. In the two cases of GNSS-denied and GNSS-challenged, the error of co-location reduced by 15.5% and 19.7%, respectively, compared with single-platform independent positioning.

Fish Swarm Based Man-Machine Cooperative Photographing Location Positioning Algorithm

Video Location Positioning Study Based on Two Steps Greedy Algorithm

Stereo Vison and Mask-RCNN Segmentation Based 3D Points Cloud Matching for Fish Dimension Measurement

Collaborative Localization of Aerial and Ground Mobile Robots Through Orthomosaic Map

Cost-effective Swarm Navigation System Via Close Cooperation

Collaborative positioning for swarms: A brief survey of vision, LiDAR and wireless sensors based methods

Human Localization in a Cluttered Space Using Multiple Cameras

Simultaneous Localization and Mapping: Swarm Robot Mutual Localization and Sonar Arc Bidirectional Carving Mapping

Localization Method for Underwater Robot Swarms Based on Enhanced Visual Markers

Underwater Target Recognition Using Artificial Fish-Swarm Algorithm

Enabling Surveillance Cameras to Navigate

Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion.

Where Should I Stand? Learning Based Human Position Recommendation for Mobile Photographing

Robust Positioning Estimation for Underwater Acoustics Targets with Use of Multi-Particle Swarm Optimization

Automatic 3D Tracking System for Large Swarm of Moving Objects

Where am I? SLAM for Mobile Machines on A Smart Working Site

Relative Localization within a Quadcopter Unmanned Aerial Vehicle Swarm Based on Airborne Monocular Vision

An Aerial and Ground Multi-Agent Cooperative Location Framework in GNSS-Challenged Environments

A LiDAR-depth camera information fusion method for human robot collaboration environment

Underwater Mapping and Optimization Based on Multibeam Echo Sounders

Graph Matching for Underwater Simultaneous Localization and Mapping Using Multibeam Sonar Imaging