Abstract:Addressing multiagent decision problems in AI, especially those involving collaborative or competitive agents acting concurrently in a partially observable and stochastic environment, remains a formidable challenge. While Interactive Dynamic Influence Diagrams~(I-DIDs) have offered a promising decision framework for such problems, they encounter limitations when the subject agent encounters unknown behaviors exhibited by other agents that are not explicitly modeled within the I-DID. This can lead to sub-optimal responses from the subject agent. In this paper, we propose a novel data-driven approach that utilizes an encoder-decoder architecture, particularly a variational autoencoder, to enhance I-DID solutions. By integrating a perplexity-based tree loss function into the optimization algorithm of the variational autoencoder, coupled with the advantages of Zig-Zag One-Hot encoding and decoding, we generate potential behaviors of other agents within the I-DID that are more likely to contain their true behaviors, even from limited interactions. This new approach enables the subject agent to respond more appropriately to unknown behaviors, thus improving its decision quality. We empirically demonstrate the effectiveness of the proposed approach in two well-established problem domains, highlighting its potential for handling multi-agent decision problems with unknown behaviors. This work is the first time of using neural networks based approaches to deal with the I-DID challenge in agent planning and learning problems.

A Model Recognition Approach for Solving Interactive Dynamic Influence Diagrams

An Influence Diagram Approach For Multiagent Time-Critical Dynamic Decision Modeling

Approximate Solution for Interactive Dynamic Influence Diagrams Based on Belief-Behavior Graphs

Model inference of a dynamic system by fuzzy learning of geometric structures

Variational Auto-encoder Based Solutions to Interactive Dynamic Influence Diagrams

Double compression of models for interactive dynamic influence diagrams

Interactive dynamic influence diagrams with communication decision

Modeling Decision Process in Multi-Agent Systems: A Graphical Markov Game Based Approach

A Research on Graph-Based Model of MAS

Time-Critical Decision Making in Interactive Dynamic Influence Diagram.

Time-critical Interactive Dynamic Influence Diagram

Diversifying Agent's Behaviors in Interactive Decision Models

Time-critical dynamic decision making

A Multi-Agent Learning Model Based on Dynamic Fuzzy Logic.

On-Line Modeling of Dynamic Nonlinear System Based on Bayesian Inferring Method Combined with Evolutionary Algorithms

Incremental Learning for Interaction Dynamics with the Influence Model

Research On Modeling The Nonhomogenous Markov Decision Systems With Dynamic Bayesian Network

Decision Making of Networked Multiagent Systems for Interaction Structures

Progress for Application and Preparation of Interactive Dynamic Influence Diagrams

The model of multi-agent cooperation in the dynamic environment

Dependency Structure Search Bayesian Optimization for Decision Making Models