Repeated Keyword Auctions Played by Finite Automata

Wenkui Ding,Tie-Yan Liu,Tao Qin,Pingzhong Tang

2013-01-01

Abstract:While our understanding of keyword auctions, and generalized second-price auctions (GSP) in particular, as single-shot games has been advanced immensely over the past decade, there are perversely few works that consider them as repeated games, given their nature of repeated execution. One reason is that repeated games are generally hard to analyze when the underlying stage games are complex. Existing work of this sort largely focuses on the so-called Myopic best response strategies where agents always best respond to the plays of the previous round. Best response strategies have clear intuitions and could sometimes accidentally explain certain bidding behaviors risen in real data, unfortunately, they are vulnerable to manipulation and fail to form equilibria. The second reason is that, Folk theorem demystifies equilibria in repeated games, by saying that every sensible utility profile can be achieved by a Nash equilibrium, leaving little space for exploration on the game theoretical front. However, merely looking at the payoffs can hardly help us understand the rationality of the advertisers’ bidding strategies or some very interesting interactions they develop during the course of repeated play. In this paper, we restrict attention to the set of strategies that can be described by Mealy machines, a type of finite automata that generalizes Moore machine, which is widely used to model repeated prisoner’s dilemma (PD). The set of automation strategies are rich enough to implement a wide variety of outcomes: we prove a new version of Folk theorem by explicitly constructing a pair of two-state Mealy machines that can form sub-game perfect equilibrium (SPE). This is in sharp contrast to previous work on myopic best responses, which cannot form any equilibrium at all. The new Folk theorem subsumes a previous Folk theorem that uses two-state Moore machines. The construction also facilitates optimizations over the set of outcomes for certain desirable objectives. The set of automation strategies are also descriptive enough to capture interesting interactions between advertisers, such as collusions, threats and punishments. This is also in sharp contrast to the line of work on Folk theorem, which says little on the rationality and intuitions of strategies. Specifically, we find that strategies such as Tit-for-Tat, Grim Trigger as well as Punisher, all of which mainly used for PD, also have their counterparts in repeated keyword auctions. Moreover, we obtain sufficient 2 Wenkui Ding, Tie-Yan Liu, Tao Qin, and Pingzhong Tang conditions under which these strategies form SPE. Our proof of SPE is based on a novel generalization of single-deviation principle, which might be of independent interests.