Abstract:We consider a seller who repeatedly sells a nondurable product to a single customer whose valuations of the product are drawn from a certain distribution. The seller, who initially does not know the valuation distribution, may use the customer's purchase history to learn, and wishes to choose a pricing policy that maximizes her long‐run revenue. Such a problem is at the core of personalized revenue management where the seller can access each customer's individual purchase history and offer personalized prices. In this paper, we study such a learning problem when the customer is aware of the seller's policy, and thus may behave strategically when making a purchase decision. By using a Bayesian setting with a binary prior, we first show that a popular policy in this setting — the myopic Bayesian policy (MBP) proposed by Harrison et al. (2012) — may lead to incomplete learning of the seller, namely, the seller may never be able to ascertain the true type of the customer and the regret may grow linearly in time. The failure of the MBP is due to the strategic action taken by the customer. To address the strategic behavior of the customers, we first analyze a Stackelberg game under a two‐period model. We derive the optimal policy of the seller in the two‐period model and show that the regret can be significantly reduced by using the optimal policy rather than the myopic policy. However, such game is hard to analyze in general. Nevertheless, based on the idea used in the two‐period model, we propose a randomized Bayesian policy (RBP), which updates the posterior belief of the customer in each period with a certain probability, as well as a deterministic Bayesian policy (DBP), in which the seller updates the posterior belief periodically and always defers her update to the next cycle. For both the RBP and the DBP, we show that the seller can learn the customer type exponentially fast even if the customer is strategic, and the regret is bounded by a constant. We also propose policies that achieve asymptotically optimal regrets when only a finite number of price changes are allowed. This article is protected by copyright. All rights reserved

On Bayesian Epistemology of Myerson Auction.

From Bayesian to Crowdsourced Bayesian Auctions.

Information Elicitation for Bayesian Auctions.

On Robustness to $k$-wise Independence of Optimal Bayesian Mechanisms

Econometrics for Learning Agents

Crowdsourced Bayesian Auctions

Perfect Bayesian Equilibria in Repeated Sales

Asymptotic Behavior of Bayesian Learners with Misspecified Models

On the Convergence of Learning Algorithms in Bayesian Auction Games

Bayesian auctions with efficient queries

Learning Truthful, Efficient, and Welfare Maximizing Auction Rules

Infer Your Enemies and Know Yourself, Learning in Real-Time Bidding with Partially Observable Opponents

Boundedly Rational Agents in Sequential Posted Pricing

Self-Confirming Price Prediction Strategies for Simultaneous One-Shot Auctions

G T ] 2 6 Ju n 20 18 Information Elicitation for Bayesian Auctions ∗

Bayesian dynamic learning and pricing with strategic customers

Bid Prediction in Repeated Auctions with Learning

A Game-Theoretic Analysis of the Empirical Revenue Maximization Algorithm with Endogenous Sampling.

Leveraging Possibilistic Beliefs in Unrestricted Combinatorial Auctions

Applying Opponent Modeling for Automatic Bidding in Online Repeated Auctions

Learn to Play Maximum Revenue Auction.