Abstract:Recent years are seeing an increasing need for on-line monitoring of teams of cooperating agents, e.g., for visualization, or performance tracking. However, in monitoring deployed teams, we often cannot rely on the agents to always communicate their state to the monitoring system. This paper presents a non-intrusive approach to monitoring by 'overhearing', where the monitored team's state is inferred (via plan-recognition) from team-members' routine communications, exchanged as part of their coordinated task execution, and observed (overheard) by the monitoring system. Key challenges in this approach include the demanding run-time requirements of monitoring, the scarceness of observations (increasing monitoring uncertainty), and the need to scale-up monitoring to address potentially large teams. To address these, we present a set of complementary novel techniques, exploiting knowledge of the social structures and procedures in the monitored team: (i) an efficient probabilistic plan-recognition algorithm, well-suited for processing communications as observations; (ii) an approach to exploiting knowledge of the team's social behavior to predict future observations during execution (reducing monitoring uncertainty); and (iii) monitoring algorithms that trade expressivity for scalability, representing only certain useful monitoring hypotheses, but allowing for any number of agents and their different activities to be represented in a single coherent entity. We present an empirical evaluation of these techniques, in combination and apart, in monitoring a deployed team of agents, running on machines physically distributed across the country, and engaged in complex, dynamic task execution. We also compare the performance of these techniques to human expert and novice monitors, and show that the techniques presented are capable of monitoring at human-expert levels, despite the difficulty of the task.

Recognizing Multi-Agent Plans when Action Models and Team Plans Are Both Incomplete

An AI Planning-Based Approach to the Multi-Agent Plan Recognition Problem

A Plan Recognition Approach for Agent in Adversarial Multi-Agent System

Multi-Agent Path Finding with Delay Probabilities

An approach to multi-agent planning with incomplete information

Cooperative Multi-Agent Planning: A Survey

Cooperative Reward Shaping for Multi-Agent Pathfinding

Attention-Cooperated Reinforcement Learning for Multi-agent Path Planning

On Computing Universal Plans for Partially Observable Multi-Agent Path Finding

Monitoring Teams by Overhearing: A Multi-Agent Plan-Recognition Approach

MAPP: a Scalable Multi-Agent Path Planning Algorithm with Tractability and Completeness Guarantees

A Flexible Coupling Approach to Multi-Agent Planning under Incomplete Information

SACHA: Soft Actor-Critic with Heuristic-Based Attention for Partially Observable Multi-Agent Path Finding

Learning Attention-Based Strategies to Cooperate for Multi-Agent Path Finding

Cooperative Multi-Agent Path Finding: Beyond Path Planning and Collision Avoidance

Overview: Generalizations of Multi-Agent Path Finding to Real-World Scenarios

Active Neural Topological Mapping for Multi-Agent Exploration

CTRMs: Learning to Construct Cooperative Timed Roadmaps for Multi-agent Path Planning in Continuous Spaces

Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learning

FMAP: Distributed Cooperative Multi-Agent Planning

A Framework for Sequential Planning in Multi-Agent Settings