Abstract:In many repeated auction settings, participants care not only about how frequently they win but also how their winnings are distributed over time. This problem arises in various practical domains where avoiding congested demand is crucial, such as online retail sales and compute services, as well as in advertising campaigns that require sustained visibility over time. We introduce a simple model of this phenomenon, modeling it as a budgeted auction where the value of a win is a concave function of the time since the last win. This implies that for a given number of wins, even spacing over time is optimal. We also extend our model and results to the case when not all wins result in "conversions" (realization of actual gains), and the probability of conversion depends on a context. The goal is to maximize and evenly space conversions rather than just wins. We study the optimal policies for this setting in second-price auctions and offer learning algorithms for the bidders that achieve low regret against the optimal bidding policy in a Bayesian online setting. Our main result is a computationally efficient online learning algorithm that achieves $\tilde O(\sqrt T)$ regret. We achieve this by showing that an infinite-horizon Markov decision process (MDP) with the budget constraint in expectation is essentially equivalent to our problem, even when limiting that MDP to a very small number of states. The algorithm achieves low regret by learning a bidding policy that chooses bids as a function of the context and the system's state, which will be the time elapsed since the last win (or conversion). We show that state-independent strategies incur linear regret even without uncertainty of conversions. We complement this by showing that there are state-independent strategies that, while still having linear regret, achieve a $(1-\frac 1 e)$ approximation to the optimal reward.

Learning to Bid Optimally and Efficiently in Adversarial First-price Auctions

Strategically-Robust Learning Algorithms for Bidding in First-Price Auctions

No-regret Learning in Repeated First-Price Auctions with Budget Constraints

Leveraging the Hints: Adaptive Bidding in Repeated First-Price Auctions

Learning to Bid in Repeated First-Price Auctions with Budgets

Fast Rate Learning in Stochastic First Price Bidding

Learning in Budgeted Auctions with Spacing Objectives

Autobidders with Budget and ROI Constraints: Efficiency, Regret, and Pacing Dynamics

Infer Your Enemies and Know Yourself, Learning in Real-Time Bidding with Partially Observable Opponents

Advancing Ad Auction Realism: Practical Insights & Modeling Implications

Competitive Auctions with Imperfect Predictions

Learning in Repeated Multi-Unit Pay-As-Bid Auctions

Learning against Non-credible Auctions.

Learning to Bid in Contextual First Price Auctions

Advertiser-First: A Receding Horizon Bid Optimization Strategy for Online Advertising

Improved Online Learning Algorithms for CTR Prediction in Ad Auctions

Online learning in repeated auctions

Online Bidding Algorithms for Return-on-Spend Constrained Advertisers

Truthful Bandit Mechanisms for Repeated Two-stage Ad Auctions

Pacing Equilibrium in First-Price Auction Markets

Truthful Auctions for Automated Bidding in Online Advertising