Abstract:In many repeated auction settings, participants care not only about how frequently they win but also how their winnings are distributed over time. This problem arises in various practical domains where avoiding congested demand is crucial, such as online retail sales and compute services, as well as in advertising campaigns that require sustained visibility over time. We introduce a simple model of this phenomenon, modeling it as a budgeted auction where the value of a win is a concave function of the time since the last win. This implies that for a given number of wins, even spacing over time is optimal. We also extend our model and results to the case when not all wins result in "conversions" (realization of actual gains), and the probability of conversion depends on a context. The goal is to maximize and evenly space conversions rather than just wins. We study the optimal policies for this setting in second-price auctions and offer learning algorithms for the bidders that achieve low regret against the optimal bidding policy in a Bayesian online setting. Our main result is a computationally efficient online learning algorithm that achieves $\tilde O(\sqrt T)$ regret. We achieve this by showing that an infinite-horizon Markov decision process (MDP) with the budget constraint in expectation is essentially equivalent to our problem, even when limiting that MDP to a very small number of states. The algorithm achieves low regret by learning a bidding policy that chooses bids as a function of the context and the system's state, which will be the time elapsed since the last win (or conversion). We show that state-independent strategies incur linear regret even without uncertainty of conversions. We complement this by showing that there are state-independent strategies that, while still having linear regret, achieve a $(1-\frac 1 e)$ approximation to the optimal reward.

Loss Aversion and Learning to Bid

Myopic Loss Aversion or Equate-to-differentiate Heuristic? A Heuristic Decision Making Model for Both Single and Aggregated Plays.

Expectations-based Loss Aversion in Contests

Investigating the Winner’s Curse Based on Decision Making in an Auction Environment

Bid Prediction in Repeated Auctions with Learning

Going, going, gone: competitive decision-making in Dutch auctions

License Bidding – Sunk Costs that Matter

What Brings a Consumer Back for More? Evidence from Quantifiable Gain and Loss Experiences in Penny Auctions

Online learning in repeated auctions

Learning in Budgeted Auctions with Spacing Objectives

A behavioral definition of loss aversion

Learning in Repeated Multi-Unit Pay-As-Bid Auctions

Learning to Bid in Contextual First Price Auctions

Competition strength influences individual preferences in an auction game

Expectations-Based Loss Aversion May Help Explain Seemingly Dominated Choices in Strategy-Proof Mechanisms

Loss aversion in strategy-proof school-choice mechanisms

Learning to Bid Optimally and Efficiently in Adversarial First-price Auctions

Individual-level loss aversion in riskless and risky choices

Bidding in Multi-Unit Auctions under Limited Information

Dynamic Incentive-Aware Learning: Robust Pricing in Contextual Auctions

Hypothetical thinking and the winner’s curse: an experimental investigation