Abstract:Accurate and robust state estimation is critical for autonomous navigation of robot teams. This task is especially challenging for large groups of size, weight, and power (SWAP) constrained aerial robots operating in perceptually-degraded GPS-denied environments. We can, however, actively increase the amount of perceptual information available to such robots by augmenting them with a small number of more expensive, but less resource-constrained, agents. Specifically, the latter can serve as sources of perceptual information themselves. In this paper, we study the problem of optimally positioning (and potentially navigating) a small number of more capable agents to enhance the perceptual environment for their lightweight,inexpensive, teammates that only need to rely on cameras and IMUs. We propose a numerically robust, computationally efficient approach to solve this problem via nonlinear optimization. Our method outperforms the standard approach based on the greedy algorithm, while matching the accuracy of a heuristic evolutionary scheme for global optimization at a fraction of its running time. Ultimately, we validate our solution in both photorealistic simulations and real-world experiments. In these experiments, we use lidar-based autonomous ground vehicles as the more capable agents, and vision-based aerial robots as their SWAP-constrained teammates. Our method is able to reduce drift in visual-inertial odometry by as much as 90%, and it outperforms random positioning of lidar-equipped agents by a significant margin. Furthermore, our method can be generalized to different types of robot teams with heterogeneous perception capabilities. It has a wide range of applications, such as surveying and mapping challenging dynamic environments, and enabling resilience to large-scale perturbations that can be caused by earthquakes or storms.

Tightly-Coupled Perception and Navigation of Heterogeneous Land-Air Robots in Complex Scenarios.

ColAG: A Collaborative Air-Ground Framework for Perception-Limited UGVs' Navigation

Cost-effective Swarm Navigation System Via Close Cooperation

Meeting-Merging-Mission: A Multi-robot Coordinate Framework for Large-Scale Communication-Limited Exploration.

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Vision-Based Formation Control for a Heterogeneous Multi-Robot System

Integrated Heterogeneous Multi-Robot System for Collaborative Navigation

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Hierarchical Perception-Improving for Decentralized Multi-Robot Motion Planning in Complex Scenarios

Enhancing Cooperative Exploration and Planning: UAV-Legged Robot Synergy

Heterogeneous Multi-Robot Collaboration for Coverage Path Planning in Partially Known Dynamic Environments

Efficient Collaborative Navigation Through Perception Fusion for Multi-Robots in Unknown Environments

A Cooperative Heterogeneous System Design of Unmanned Aerial and Surface Vehicles

A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments

Air-Ground Collaboration with SPOMP: Semantic Panoramic Online Mapping and Planning

Target Search and Navigation in Heterogeneous Robot Systems with Deep Reinforcement Learning

Toward a Generic Framework for Mission Planning and Execution with a Heterogeneous Multi-Robot System

Active Collaborative Localization in Heterogeneous Robot Teams

A Planning Framework for Persistent, Multi-UAV Coverage with Global Deconfliction

Multi-UAV Deployment in Obstacle-Cluttered Environments with LOS Connectivity

UGV-UAV Object Geolocation in Unstructured Environments