Abstract:We consider finite-horizon and infinite-horizon versions of a dynamic game with $N$ selfish players who observe their types privately and take actions that are publicly observed. Players' types evolve as conditionally independent Markov processes, conditioned on their current actions. Their actions and types jointly determine their instantaneous rewards. In dynamic games with asymmetric information, a widely used concept of equilibrium is perfect Bayesian equilibrium (PBE), which consists of a strategy and belief pair that simultaneously satisfy sequential rationality and belief consistency. In general, there does not exist a universal algorithm that decouples the interdependence of strategies and beliefs over time in calculating PBE. In this paper, for the finite-horizon game with independent types we develop a two-step backward-forward recursive algorithm that sequentially decomposes the problem (w.r.t. time) to obtain a subset of PBEs, which we refer to as structured Bayesian perfect equilibria (SPBE). In such equilibria, a player's strategy depends on its history only through a common public belief and its current private type. The backward recursive part of this algorithm defines an equilibrium generating function. Each period in the backward recursion involves solving a fixed-point equation on the space of probability simplexes for every possible belief on types. Using this function, equilibrium strategies and beliefs are generated through a forward recursion. We then extend this methodology to the infinite-horizon model, where we propose a time-invariant single-shot fixed-point equation, which in conjunction with a forward recursive step, generates the SPBE. Sufficient conditions for the existence of SPBE are provided. With our proposed method, we find equilibria that exhibit signaling behavior. This is illustrated with the help of a concrete public goods example.

A Simple Algorithm for Solving Ramsey Optimal Policy with Exogenous Forcing Variables

Ramsey Optimal Policy versus Multiple Equilibria with Fiscal and Monetary Interactions

A General and Efficient Method for Solving Regime-Switching DSGE Models

A Fixed-Point Policy-Iteration-Type Algorithm for Symmetric Nonzero-Sum Stochastic Impulse Control Games

Optimal dynamic regulation of carbon emissions market: A variational approach

Computing Algorithm for an Equilibrium of the Generalized Stackelberg Game

Policy Iteration for Pareto-Optimal Policies in Stochastic Stackelberg Games

Stochastic Dynamic Programming Heuristic for the (R, s, S) Policy Parameters Computation

Efficient Stackelberg Strategies for Finitely Repeated Games

The Simplicity of Optimal Dynamic Mechanisms

A systematic process for evaluating structured perfect Bayesian equilibria in dynamic games with asymmetric information

Subsidizing a New Technology: An Impulse Stackelberg Game Approach

A Stackelberg Game based on the Secretary Problem: Optimal Response is History Dependent

Watch and Learn: Optimizing from Revealed Preferences Feedback

Learning Macroeconomic Policies based on Microfoundations: A Stackelberg Mean Field Game Approach

Solving Strongly Convex and Smooth Stackelberg Games Without Modeling the Follower

Speeding up Policy Simulation in Supply Chain RL

Strong Stackelberg reasoning in symmetric games: An experimental replication and extension

Adaptive dynamic programming-based algorithm for infinite-horizon linear quadratic stochastic optimal control problems

Novel single-loop policy iteration for linear zero-sum games

Using dynamic programming with adaptive grid scheme for optimal control problems in economics