Abstract:We study mechanism design for nonexcludable and excludable binary public project problems. Our aim is to maximize the expected number of consumers and the expected agents' welfare. We first show that for the nonexcludable public project model, there is no need for machine learning based mechanism design. We identify a sufficient condition on the prior distribution for the existing conservative equal costs mechanism to be the optimal strategy-proof and individually rational mechanism. For general distributions, we propose a dynamic program that solves for the optimal mechanism. For the excludable public project model, we identify a similar sufficient condition for the existing serial cost sharing mechanism to be optimal for 2 and 3 agents. We derive a numerical upper bound and use it to show that for several common distributions, the serial cost sharing mechanism is close to optimality. The serial cost sharing mechanism is not optimal in general. We propose three machine learning based approaches for designing better performing mechanisms. We focus on the family of largest unanimous mechanisms , which characterizes all strategy-proof and individually rational mechanisms for the excludable public project model. A largest unanimous mechanism describes an iterative mechanism, which is defined by an exponential number of mechanism parameters. Our first approach describes the largest unanimous mechanism family using a neural network and training is carried out by minimizing a cost function that combines the mechanism design objective and the constraint violation penalty. We interpret the largest unanimous mechanisms as price-oriented rationing-free (PORF) mechanisms, which enables us to move the mechanisms' iterative decision making off the neural network, to a separate simulation process, therefore avoiding the vanishing gradient problem. We also feed the prior distribution's analytical form into the cost function to achieve high-quality gradients for efficient training. Our second approach treats the mechanism design task as a Markov Decision Process with an exponential number of states. During the Markov decision process, the non-consumers are gradually removed from the system. We train multiple neural networks, each for a different number of remaining agents, to learn the optimal value function on the states. Training is carried out by supervised learning toward a set of manually prepared base cases and the Bellman equation. Our third approach is based on reinforcement learning for a Partially Observable Markov Decision Process . Each RL episode randomly draws a type profile, which is hidden from the RL agent (mechanism designer). The RL agent only observes which cost share offers have been accepted under the largest unanimous mechanism under discussion. We use a continuous action space reinforcement learning approach to adjust the offer policy (i.e., adjust mechanism parameters). Lastly, our first two approaches use "supervision to manual mechanisms" as a systematic way for network initialization, which is potentially valuable for machine learning based mechanism design in general.

Mechanism Learning with Mechanism Induced Data

Mechanism Design for Multi-Party Machine Learning

Deep Learning Meets Mechanism Design: Key Results and Some Novel Applications

Mechanism design for public projects via three machine learning based approaches

A Mechanism Design Approach for Multi-Party Machine Learning

Machine Learning Approaches to Automated Mechanism Design for Public Project Problem

HCMD-zero: Learning Value Aligned Mechanisms from Data

Deep Reinforcement Learning and Influenced Games

Generalization Analysis for Game-Theoretic Machine Learning

Distributed Mechanism Design with Learning Guarantees

Socially-Optimal Mechanism Design for Incentivized Online Learning

Automated Mechanism Design via Neural Networks

Mechanism Design Powered by Social Interactions

Learning Dynamic Mechanisms in Unknown Environments: A Reinforcement Learning Approach

Automated Dynamic Mechanism Design

Learning in Games: a Systematic Review

Computing Optimal Equilibria and Mechanisms via Learning in Zero-Sum Extensive-Form Games

Fair Multi-party Machine Learning -- a Game Theoretic approach

Learning under Imitative Strategic Behavior with Unforeseeable Outcomes

Adaptive Incentive Design with Learning Agents

Constrained Automated Mechanism Design for Infinite Games of Incomplete Information