Abstract:Algorithmic agents are used in a variety of competitive decision settings, notably in making pricing decisions in contexts that range from online retail to residential home rentals. Business managers, algorithm designers, legal scholars, and regulators alike are all starting to consider the ramifications of "algorithmic collusion." We study the emergent behavior of multi-armed bandit machine learning algorithms used in situations where agents are competing, but they have no information about the strategic interaction they are engaged in. Using a general-form repeated Prisoner's Dilemma game, agents engage in online learning with no prior model of game structure and no knowledge of competitors' states or actions (e.g., no observation of competing prices). We show that these context-free bandits, with no knowledge of opponents' choices or outcomes, still will consistently learn collusive behavior - what we call "naive collusion." We primarily study this system through an analytical model and examine perturbations to the model through simulations. Our findings have several notable implications for regulators. First, calls to limit algorithms from conditioning on competitors' prices are insufficient to prevent algorithmic collusion. This is a direct result of collusion arising even in the naive setting. Second, symmetry in algorithms can increase collusion potential. This highlights a new, simple mechanism for "hub-and-spoke" algorithmic collusion. A central distributor need not imbue its algorithm with supra-competitive tendencies for apparent collusion to arise; it can simply arise by using certain (common) machine learning algorithms. Finally, we highlight that collusive outcomes depend starkly on the specific algorithm being used, and we highlight market and algorithmic conditions under which it will be unknown a priori whether collusion occurs.

Dynamics of market making algorithms in dealer markets: Learning and tacit collusion

Cooperation between independent market makers

Algorithmic Collusion in Electronic Markets: The Impact of Tick Size

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

Tacit algorithmic collusion in deep reinforcement learning guided price competition: A study using EV charge pricing game

Deviations from the Nash equilibrium and emergence of tacit collusion in a two-player optimal execution game with reinforcement learning

Deep Reinforcement Learning for Market Making

Over-the-Counter Market Making via Reinforcement Learning

Algorithmic Collusion in Dynamic Pricing with Deep Reinforcement Learning

On Mechanism Underlying Algorithmic Collusion

Market efficiency, informational asymmetry and pseudo-collusion of adaptively learning agents

Artificial Intelligence and Spontaneous Collusion

Robust Algorithmic Collusion

Learning Collusion in Episodic, Inventory-Constrained Markets

Naive Algorithmic Collusion: When Do Bandit Learners Cooperate and When Do They Compete?

Deep Reinforcement Learning for High-Frequency Market Making

Adversarial competition and collusion in algorithmic markets

Artificial Intelligence and Algorithmic Price Collusion in Two-sided Markets

Market Making with Exogenous Competition

Algorithmic Collusion: Genuine or Spurious?

By Fair Means or Foul: Quantifying Collusion in a Market Simulation with Deep Reinforcement Learning