Abstract:As a schematic model of the complexity economic agents are confronted with, we introduce the "Sherrington-Kirkpatrick game," a discrete time binary choice model inspired from mean-field spin glasses. We show that, even in a completely static environment, agents are unable to learn collectively optimal strategies. This is either because the learning process gets trapped in a suboptimal fixed point or because learning never converges and leads to a never-ending evolution of agent intentions. Contrarily to the hope that learning might save the standard "rational expectation" framework in economics, we argue that complex situations are generically unlearnable and agents must do with satisficing solutions, as argued long ago by Simon [ Q. J. Econ. 69 , 99 (1955)]. Only a centralized, omniscient agent endowed with enormous computing power could qualify to determine the optimal strategy of all agents. Using a mix of analytical arguments and numerical simulations, we find that (i) long memory of past rewards is beneficial to learning, whereas overreaction to recent past is detrimental and leads to cycles or chaos; (ii) increased competition (nonreciprocity) destabilizes fixed points and leads first to chaos and, in the high competition limit, to quasicycles; (iii) some amount of randomness in the learning process, perhaps paradoxically, allows the system to reach better collective decisions; (iv) nonstationary, "aging" behavior spontaneously emerges in a large swath of parameter space of our complex but static world. On the positive side, we find that the learning process allows cooperative systems to coordinate around satisficing solutions with rather high (but markedly suboptimal) average reward. However, hypersensitivity to the game parameters makes it impossible to predict ex ante who will be better or worse off in our stylized economy. The statistical description of the space of satisficing solutions is an open problem. https://doi.org/10.1103/PhysRevX.14.021039 Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Published by the American Physical Society

When Does Learning in Games Generate Convergence to Nash Equilibria? The Role of Supermodularity in an Experimental Setting

When Does Learning in Games Generate Convergence to Nash Equilibria? the Role of Supermodularity in an Experimental Setting ⁄

Convergence Dynamics of Graphical Congestion Games.

On Convergence Rates of Robust Adaptive Game Theoretic Learning Algorithms

Strategic Teaching and Learning in Games

Learning in Multi-Memory Games Triggers Complex Dynamics Diverging from Nash Equilibrium

Towards convergence to Nash equilibria in two-team zero-sum games

The equivalence of dynamic and strategic stability under regularized learning in games

On the Convergence of Fictitious Play: A Decomposition Approach

Unlearnable Games and "Satisficing'' Decisions: A Simple Model for a Complex World

Stability of Multi-Agent Learning: Convergence in Network Games with Many Players

On the Convergence of Learning Algorithms in Bayesian Auction Games

Exponential Convergence of Gradient Methods in Concave Network Zero-sum Games

Convergence of Learning Dynamics in Stackelberg Games

Learning, evolution and population dynamics

Submodularity and supermodularity in contest games

Unlearnable Games and "Satisficing" Decisions: A Simple Model for a Complex World

Stability of Multi-Agent Learning in Competitive Networks: Delaying the Onset of Chaos

On convergence rates of game theoretic reinforcement learning algorithms

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Decentralized Online Learning in General-Sum Stackelberg Games