Abstract:Many real-world robotic applications such as search and rescue, disaster relief, and inspection operations are often set in unstructured environments with a restricted or unreliable communication infrastructure. In such environments, a multi-robot system must either be deployed to i) remain constantly connected, hence sacrificing operational efficiency or ii) allow disconnections considering when and how to regroup. In communication-restricted environments, we insist that the latter approach is desired to achieve a robust and predictable method for cooperative planning. One of the main challenges in achieving this goal is that optimal planning in partially unknown environments without communication requires an intractable sequence of possibilities. To solve this problem, we propose a novel epistemic planning approach for propagating beliefs about the system's states during communication loss to ensure cooperative operations. Typically used for discrete multi-player games or natural language processing, epistemic planning is a powerful representation of reasoning through events, actions, and belief revisions, given new information. Most robot applications use traditional planning to interact with their immediate environment and only consider knowledge of their own state. By including an epistemic notion in planning, a robot may enact depth-of-reasoning about the system's state, analyzing its beliefs about each robot in the system. In this method, a set of possible beliefs about other robots in the system are propagated using a Frontier-based planner to accomplish the coverage objective. As disconnections occur, each robot tracks beliefs about the system state and reasons about multiple objectives: i) coverage of the environment, ii) dissemination of new observations, and iii) possible information sharing from other robots. A task allocation optimization algorithm with gossip protocol is used in conjunction with the epistemic planning mechanism to locally optimize all three objectives, considering that in a partially unknown environment, the belief propagation may not be safe or possible to follow and that another robot may be attempting an information relay using the belief state. Results indicate that our framework performs better than the standard solution for communication restrictions and even shows similar performance to simulations with no communication limitations. Extensive experiments provide evidence of the framework's performance in real-world scenarios.

Nested Reasoning About Autonomous Agents Using Probabilistic Programs

Anytime Game-Theoretic Planning with Active Reasoning about Humans' Latent States for Human-Centered Robots

Counterfactual Reasoning about Intent for Interactive Navigation in Dynamic Environments

ReasonPlanner: Enhancing Autonomous Planning in Dynamic Environments with Temporal Knowledge Graphs and LLMs

Neural Amortized Inference for Nested Multi-agent Reasoning

iCORPP: Interleaved commonsense reasoning and probabilistic planning on robots

Probabilistic Recursive Reasoning for Multi-Agent Reinforcement Learning.

Multi-Agent Cooperation Via Reasoning About The Behavior Of Others

Probabilistic programs for inferring the goals of autonomous agents

A Dynamic Epistemic Framework for Reasoning about Conformant Probabilistic Plans

Proximity-Based Non-uniform Abstractions for Approximate Planning

Theory of Minds: Understanding Behavior in Groups Through Inverse Planning

Efficient Open World Reasoning for Planning

An Epistemic Human-Aware Task Planner which Anticipates Human Beliefs and Decisions

On Predictive Planning and Counterfactual Learning in Active Inference

Scalable Decision-Theoretic Planning in Open and Typed Multiagent Systems

A Bayesian Approach to Online Planning

Epistemic planning for multi-robot systems in communication-restricted environments

Interactive POMDP Lite: Towards Practical Planning to Predict and Exploit Intentions for Interacting with Self-Interested Agents

Real-World Deployment of a Hierarchical Uncertainty-Aware Collaborative Multiagent Planning System

A Probabilistic Model of Action for Least-Commitment Planning with Information Gather