Abstract:Scientists often search for phenomena of interest while exploring new environments. Autonomous vehicles are deployed to explore such areas where human-operated vehicles would be costly or dangerous. Online control of autonomous vehicles for information-gathering is called adaptive sampling and can be framed as a POMDP that uses information gain as its principal objective. While prior work focuses largely on single-agent scenarios, this paper confronts challenges unique to multi-agent adaptive sampling, such as avoiding redundant observations, preventing vehicle collision, and facilitating path planning under limited communication. We start with Multi-Agent Path Finding (MAPF) methods, which address collision avoidance by decomposing the MAPF problem into a series of single-agent path planning problems. We then present information-driven MAPF which addresses multi-agent information gain under limited communication. First, we introduce an admissible heuristic that relaxes mutual information gain to an additive function that can be evaluated as a set of independent single agent path planning problems. Second, we extend our approach to a distributed system that is robust to limited communication. When all agents are in range, the group plans jointly to maximize information. When some agents move out of range, communicating subgroups are formed and the subgroups plan independently. Since redundant observations are less likely when vehicles are far apart, this approach only incurs a small loss in information gain, resulting in an approach that gracefully transitions from full to partial communication. We evaluate our method against other adaptive sampling strategies across various scenarios, including real-world robotic applications. Our method was able to locate up to 200% more unique phenomena in certain scenarios, and each agent located its first unique phenomenon faster by up to 50%.

Online Planning for Multiagent Situational Information Gathering in the Markov Environment

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Research on situational awareness technology of battlefield environment based on Multi-agent Cooperation

Wireless Localization and Formation Control with Asynchronous Agents

A Multi-agent Formation Control Algorithm in Interference Environment

Sensor-based Multi-agent Coverage Control with Spatial Separation in Unstructured Environments

Distributed Multi-Target Search and Surveillance Mission Planning for Unmanned Aerial Vehicles in Uncertain Environments

A Decentralized Multiagent Based Algorithm Design for Multiple Unmanned Vehicle Chasing Problem.

Air–Ground Collaborative Multi-Target Detection Task Assignment and Path Planning Optimization

Uncertainty-Aware Planning for Heterogeneous Robot Teams using Dynamic Topological Graphs and Mixed-Integer Programming

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

Real-World Deployment of a Hierarchical Uncertainty-Aware Collaborative Multiagent Planning System

A Framework for Multi-Agent UAV Exploration and Target-Finding in GPS-Denied and Partially Observable Environments

Graph MADDPG with RNN for multiagent cooperative environment

Multi-Agent Vulcan: An Information-Driven Multi-Agent Path Finding Approach

Multi-Objective Multi-Agent Planning for Discovering and Tracking Multiple Mobile Objects

An Information Sharing Algorithm for Large Dynamic Mobile Multi-Agent Teams

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation