Abstract:In decision-making scenarios, \textit{reasoning} can be viewed as an algorithm $P$ that makes a choice of an action $a^* \in \mathcal{A}$, aiming to optimize some outcome such as maximizing the value function of a Markov decision process (MDP). However, executing $P$ itself may bear some costs (time, energy, limited capacity, etc.) and needs to be considered alongside explicit utility obtained by making the choice in the underlying decision problem. Such costs need to be taken into account in order to accurately model human behavior, as well as optimizing AI planning, as all physical systems are bound to face resource constraints. Finding the right $P$ can itself be framed as an optimization problem over the space of reasoning processes $P$, generally referred to as \textit{metareasoning}. Conventionally, human metareasoning models assume that the agent knows the transition and reward distributions of the underlying MDP. This paper generalizes such models by proposing a meta Bayes-Adaptive MDP (meta-BAMDP) framework to handle metareasoning in environments with unknown reward/transition distributions, which encompasses a far larger and more realistic set of planning problems that humans and AI systems face. As a first step, we apply the framework to two-armed Bernoulli bandit (TABB) tasks, which have often been used to study human decision making. Owing to the meta problem's complexity, our solutions are necessarily approximate, but nevertheless robust within a range of assumptions that are arguably realistic for human decision-making scenarios. These results offer a normative framework for understanding human exploration under cognitive constraints. This integration of Bayesian adaptive strategies with metareasoning enriches both the theoretical landscape of decision-making research and practical applications in designing AI systems that plan under uncertainty and resource constraints.

Parole Board Decision-Making using Adversarial Risk Analysis

Adversarial Risk Analysis (Overview)

On global robustness of an adversarial risk analysis solution

Computational Efficiency in Multivariate Adversarial Risk Analysis Models

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

Metareasoning in uncertain environments: a meta-BAMDP framework

Predicting risk in criminal procedure: actuarial tools, algorithms, AI and judicial decision-making

Probabilistic Perspectives on Error Minimization in Adversarial Reinforcement Learning

Risk-Averse Bayes-Adaptive Reinforcement Learning

A Game-Theoretic Framework for Managing Risk in Multi-Agent Systems

An agent-based model of repeated decision making under risk: modeling the role of alternate reference points and risk behavior on long-run outcomes

Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment

Algorithmic Decision Making in the Presence of Unmeasured Confounding

SAAC: Safe Reinforcement Learning as an Adversarial Game of Actor-Critics

A survey of decision making in adversarial games

Personalized Algorithmic Recourse with Preference Elicitation

ABI Approach: Automatic Bias Identification in Decision-Making Under Risk based in an Ontology of Behavioral Economics

Counterfactual risk assessments, evaluation, and fairness

Strategic Play By Resource-Bounded Agents in Security Games

Bayesian Safe Policy Learning with Chance Constrained Optimization: Application to Military Security Assessment during the Vietnam War

Risk-averse Batch Active Inverse Reward Design