Abstract:First-price auctions have very recently swept the online advertising industry, replacing second-price auctions as the predominant auction mechanism on many platforms. This shift has brought forth important challenges for a bidder: how should one bid in a first-price auction, where unlike in second-price auctions, it is no longer optimal to bid one's private value truthfully and hard to know the others' bidding behaviors? In this paper, we take an online learning angle and address the fundamental problem of learning to bid in repeated first-price auctions, where both the bidder's private valuations and other bidders' bids can be arbitrary. We develop the first minimax optimal online bidding algorithm that achieves an $\widetilde{O}(\sqrt{T})$ regret when competing with the set of all Lipschitz bidding policies, a strong oracle that contains a rich set of bidding strategies. This novel algorithm is built on the insight that the presence of a good expert can be leveraged to improve performance, as well as an original hierarchical expert-chaining structure, both of which could be of independent interest in online learning. Further, by exploiting the product structure that exists in the problem, we modify this algorithm--in its vanilla form statistically optimal but computationally infeasible--to a computationally efficient and space efficient algorithm that also retains the same $\widetilde{O}(\sqrt{T})$ minimax optimal regret guarantee. Additionally, through an impossibility result, we highlight that one is unlikely to compete this favorably with a stronger oracle (than the considered Lipschitz bidding policies). Finally, we test our algorithm on three real-world first-price auction datasets obtained from Verizon Media and demonstrate our algorithm's superior performance compared to several existing bidding algorithms.

Sealed Bid Auctions with Ambiguity: Theory and Experiments

Auctioneer Behavior When Bidders Face Ambiguity : An Experimental Study ∗

Robust auctions with affiliated private values

Empirical Relevance of Ambiguity in First Price Auction Models

Sealed-Bid Auctions with Human Auctioneers : An Experimental Study ∗

Common-Value Auctions with Discrete Private Information

Strategic behavior in dynamic auctions

Bidding under Uncertainty: Theory and Experiments

Impact of Dependence among Valuations on Expected Revenue in Auctions

Goodwill Can Hurt: A Theoretical and Experimental Investigation of Return Policies in Auctions.

Auctions and Bidding: A Primer

Smarter than others? Conjectures in lowest unique bid auctions

Inference in Auctions with Many Bidders Using Transaction Prices

Multi-Object Auctions with Package Bidding : An Experimental Comparison of i BEA and Vickrey ∗

All-pay Auctions with Endogenous Bid Timing: an Experimental Study

Simultaneous Vs. Sequential Auctions, Intensity of Competition and Uncertainty

Simultaneous Vs. Sequential Sales: Bidder Competition and Supply Uncertainty

A Study of First-price Sealed-bid Procurement Auctions for Divisible Items

Advertising a second-price auction

An Empirical Investigation of the Auction Buyer's Choice to Buy out or Bid: Cry of Regret or Laugh of Satisfaction?

Learning to Bid Optimally and Efficiently in Adversarial First-price Auctions