Data-Driven Goal Recognition Design for General Behavioral Agents

Robert Kasumba,Guanghui Yu,Chien-Ju Ho,Sarah Keren,William Yeoh

2024-06-12

Abstract:Goal recognition design aims to make limited modifications to decision-making environments with the goal of making it easier to infer the goals of agents acting within those environments. Although various research efforts have been made in goal recognition design, existing approaches are computationally demanding and often assume that agents are (near-)optimal in their decision-making. To address these limitations, we introduce a data-driven approach to goal recognition design that can account for agents with general behavioral models. Following existing literature, we use worst-case distinctiveness($\textit{wcd}$) as a measure of the difficulty in inferring the goal of an agent in a decision-making environment. Our approach begins by training a machine learning model to predict the $\textit{wcd}$ for a given environment and the agent behavior model. We then propose a gradient-based optimization framework that accommodates various constraints to optimize decision-making environments for enhanced goal recognition. Through extensive simulations, we demonstrate that our approach outperforms existing methods in reducing $\textit{wcd}$ and enhancing runtime efficiency in conventional setup. Moreover, our approach also adapts to settings in which existing approaches do not apply, such as those involving flexible budget constraints, more complex environments, and suboptimal agent behavior. Finally, we have conducted human-subject experiments which confirm that our method can create environments that facilitate efficient goal recognition from real-world human decision-makers.

Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper aims to address two major limitations in goal recognition design: computational complexity and the assumption of optimal agent behavior. Specifically:

1. **Computational Efficiency**: Existing goal recognition design methods require significant computational resources when evaluating modifications to the decision environment, as each modification necessitates solving for the optimal policy multiple times to compute the worst-case distinctiveness (wcd). This computational burden limits the scalability of these methods in virtual domains.

2. **Agent Behavior Model**: Current methods often assume that the agent's behavior is approximately optimal, which is limiting when dealing with human agents, as human agents frequently deviate from optimal decisions due to cognitive and informational constraints.

To address these issues, the authors propose a data-driven goal recognition design framework that improves existing methods in the following ways:
- Utilizing machine learning models to predict the wcd value given a decision environment and agent behavior model.
- Proposing a gradient-based optimization framework to minimize wcd, employing Lagrangian relaxation to handle constraints on environment modifications.
- This approach is not only applicable to standard settings but also adaptable to more complex environments, flexible budget constraints, and suboptimal agent behavior.

The experimental section demonstrates the superior performance of this method in standard benchmarks and shows its effectiveness in more complex environments (such as Overcooked-AI) and with suboptimal agent behavior. Additionally, the authors conducted experiments with real human subjects, validating that their method can create real-world environments conducive to efficient goal recognition. Overall, this research aims to enhance the efficiency of human-AI collaboration by introducing a data-driven approach.