Abstract:We consider finite-horizon and infinite-horizon versions of a dynamic game with $N$ selfish players who observe their types privately and take actions that are publicly observed. Players' types evolve as conditionally independent Markov processes, conditioned on their current actions. Their actions and types jointly determine their instantaneous rewards. In dynamic games with asymmetric information, a widely used concept of equilibrium is perfect Bayesian equilibrium (PBE), which consists of a strategy and belief pair that simultaneously satisfy sequential rationality and belief consistency. In general, there does not exist a universal algorithm that decouples the interdependence of strategies and beliefs over time in calculating PBE. In this paper, for the finite-horizon game with independent types we develop a two-step backward-forward recursive algorithm that sequentially decomposes the problem (w.r.t. time) to obtain a subset of PBEs, which we refer to as structured Bayesian perfect equilibria (SPBE). In such equilibria, a player's strategy depends on its history only through a common public belief and its current private type. The backward recursive part of this algorithm defines an equilibrium generating function. Each period in the backward recursion involves solving a fixed-point equation on the space of probability simplexes for every possible belief on types. Using this function, equilibrium strategies and beliefs are generated through a forward recursion. We then extend this methodology to the infinite-horizon model, where we propose a time-invariant single-shot fixed-point equation, which in conjunction with a forward recursive step, generates the SPBE. Sufficient conditions for the existence of SPBE are provided. With our proposed method, we find equilibria that exhibit signaling behavior. This is illustrated with the help of a concrete public goods example.

Sequential Sampling Equilibrium

Collective Sampling: An Ex Ante Perspective

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Observable Perfect Equilibrium

Learning Equilibria of Simulation-Based Games

Sequential spatially balanced sampling

Empirical Distribution of Equilibrium Play and Its Testing Application

Buying Data Over Time: Approximately Optimal Strategies for Dynamic Data-Driven Decisions

Stochastic Game with Interactive Information Acquisition: Pipelined Perfect Markov Bayesian Equilibrium

Non-strategic Econometrics (for Initial Play)

Sequential Sampling to Myopically Maximize the Expected Value of Information

Actions Speak What You Want: Provably Sample-Efficient Reinforcement Learning of the Quantal Stackelberg Equilibrium from Strategic Feedbacks

A Nash Equilibrium for Differential Games with Moving-Horizon Strategies

Sequential Sampling for Bayesian Robust Ranking and Selection

Ensemble Rejection Sampling

A Sequential Sampling Procedure for Stochastic Programming

Ranking and Selection as Stochastic Control

Dynamic programming of some sequential sampling design

Testing Models of Strategic Uncertainty: Equilibrium Selection in Repeated Games

A systematic process for evaluating structured perfect Bayesian equilibria in dynamic games with asymmetric information

STRUCTURAL ESTIMATION OF SEQUENTIAL GAMES OF COMPLETE INFORMATION