Abstract:In many repeated auction settings, participants care not only about how frequently they win but also how their winnings are distributed over time. This problem arises in various practical domains where avoiding congested demand is crucial, such as online retail sales and compute services, as well as in advertising campaigns that require sustained visibility over time. We introduce a simple model of this phenomenon, modeling it as a budgeted auction where the value of a win is a concave function of the time since the last win. This implies that for a given number of wins, even spacing over time is optimal. We also extend our model and results to the case when not all wins result in "conversions" (realization of actual gains), and the probability of conversion depends on a context. The goal is to maximize and evenly space conversions rather than just wins. We study the optimal policies for this setting in second-price auctions and offer learning algorithms for the bidders that achieve low regret against the optimal bidding policy in a Bayesian online setting. Our main result is a computationally efficient online learning algorithm that achieves $\tilde O(\sqrt T)$ regret. We achieve this by showing that an infinite-horizon Markov decision process (MDP) with the budget constraint in expectation is essentially equivalent to our problem, even when limiting that MDP to a very small number of states. The algorithm achieves low regret by learning a bidding policy that chooses bids as a function of the context and the system's state, which will be the time elapsed since the last win (or conversion). We show that state-independent strategies incur linear regret even without uncertainty of conversions. We complement this by showing that there are state-independent strategies that, while still having linear regret, achieve a $(1-\frac 1 e)$ approximation to the optimal reward.

Liquid Welfare Guarantees for No-Regret Learning in Sequential Budgeted Auctions

Liquid Price of Anarchy

Improved Efficiency Guarantees in Auctions with Budgets

Budget Pacing in Repeated Auctions: Regret and Efficiency without Convergence

No-regret Learning in Repeated First-Price Auctions with Budget Constraints

Autobidders with Budget and ROI Constraints: Efficiency, Regret, and Pacing Dynamics

Selling to Multiple No-Regret Buyers

Learning in Budgeted Auctions with Spacing Objectives

When Are Welfare Guarantees Robust?

Individual Welfare Guarantees in the Autobidding World with Machine-learned Advice

Learning to Bid in Repeated First-Price Auctions with Budgets

Non-uniform Bid-scaling and Equilibria for Different Auctions: An Empirical Study

No-Regret Learning in Bilateral Trade via Global Budget Balance

Strategizing against No-Regret Learners in First-Price Auctions

Randomized Truthful Auctions with Learning Agents

Improved Social Welfare Bounds for GSP at Equilibrium

No-Regret Learning in Bayesian Games

Randomized learning-augmented auctions with revenue guarantees

Auction Design for Value Maximizers with Budget and Return-on-spend Constraints

A Dynamic Axiomatic Approach to First-Price Auctions

Learning Truthful, Efficient, and Welfare Maximizing Auction Rules