Abstract:Recent years are seeing an increasing need for on-line monitoring of teams of cooperating agents, e.g., for visualization, or performance tracking. However, in monitoring deployed teams, we often cannot rely on the agents to always communicate their state to the monitoring system. This paper presents a non-intrusive approach to monitoring by 'overhearing', where the monitored team's state is inferred (via plan-recognition) from team-members' routine communications, exchanged as part of their coordinated task execution, and observed (overheard) by the monitoring system. Key challenges in this approach include the demanding run-time requirements of monitoring, the scarceness of observations (increasing monitoring uncertainty), and the need to scale-up monitoring to address potentially large teams. To address these, we present a set of complementary novel techniques, exploiting knowledge of the social structures and procedures in the monitored team: (i) an efficient probabilistic plan-recognition algorithm, well-suited for processing communications as observations; (ii) an approach to exploiting knowledge of the team's social behavior to predict future observations during execution (reducing monitoring uncertainty); and (iii) monitoring algorithms that trade expressivity for scalability, representing only certain useful monitoring hypotheses, but allowing for any number of agents and their different activities to be represented in a single coherent entity. We present an empirical evaluation of these techniques, in combination and apart, in monitoring a deployed team of agents, running on machines physically distributed across the country, and engaged in complex, dynamic task execution. We also compare the performance of these techniques to human expert and novice monitors, and show that the techniques presented are capable of monitoring at human-expert levels, despite the difficulty of the task.

Robust Agent Teams via Socially-Attentive Monitoring

Monitoring Teams by Overhearing: A Multi-Agent Plan-Recognition Approach

Interactive Execution Monitoring of Agent Teams

Multi-Agent Team Access Monitoring: Environments that Benefit from Target Information Sharing

Distributed misbehavior monitors for socially organized autonomous systems

Distributed Adaptive Event-Triggered Fault-Tolerant Synchronization for Multiagent Systems

Decentralized Event-Driven Algorithms for Multi-Agent Persistent Monitoring

Multi-agent Coordination Under Temporal Logic Tasks and Team-Wise Intermittent Communication

Towards Flexible Coordination of Large Scale Multi-Agent Teams

A Submodular Receding Horizon Control Strategy to Distributed Persistent Monitoring

Statistical Monitoring of Complex Chemical Processes Using Agent-Based Systems

Scaling Teamwork to Very Large Teams

Monitoring communication outbreaks among an unknown team of actors in dynamic networks

Resilient Monitoring in Heterogeneous Multi-Robot Systems Through Network Reconfiguration

An Alert-Generation Framework for Improving Resiliency in Human-Supervised, Multi-Agent Teams

An Agent-Based Monitoring Framework for Distributed Complex Engineering Simulation System

Verifying Team Formation Protocols With Probabilistic Model Checking

Robust Adaptive Consensus Tracking for Higher-Order Multi-Agent Uncertain Systems with Nonlinear Dynamics Via Distributed Intermittent Communication Protocol

Attention-Based Fault-Tolerant Approach for Multi-Agent Reinforcement Learning Systems

Stochastic Nonlinear Ensemble Modeling and Control for Robot Team Environmental Monitoring

Consensus Tracking of Linear Multi-Agent Systems under Networked Observability Conditions