Abstract:We consider a seller who repeatedly sells a nondurable product to a single customer whose valuations of the product are drawn from a certain distribution. The seller, who initially does not know the valuation distribution, may use the customer's purchase history to learn, and wishes to choose a pricing policy that maximizes her long‐run revenue. Such a problem is at the core of personalized revenue management where the seller can access each customer's individual purchase history and offer personalized prices. In this paper, we study such a learning problem when the customer is aware of the seller's policy, and thus may behave strategically when making a purchase decision. By using a Bayesian setting with a binary prior, we first show that a popular policy in this setting — the myopic Bayesian policy (MBP) proposed by Harrison et al. (2012) — may lead to incomplete learning of the seller, namely, the seller may never be able to ascertain the true type of the customer and the regret may grow linearly in time. The failure of the MBP is due to the strategic action taken by the customer. To address the strategic behavior of the customers, we first analyze a Stackelberg game under a two‐period model. We derive the optimal policy of the seller in the two‐period model and show that the regret can be significantly reduced by using the optimal policy rather than the myopic policy. However, such game is hard to analyze in general. Nevertheless, based on the idea used in the two‐period model, we propose a randomized Bayesian policy (RBP), which updates the posterior belief of the customer in each period with a certain probability, as well as a deterministic Bayesian policy (DBP), in which the seller updates the posterior belief periodically and always defers her update to the next cycle. For both the RBP and the DBP, we show that the seller can learn the customer type exponentially fast even if the customer is strategic, and the regret is bounded by a constant. We also propose policies that achieve asymptotically optimal regrets when only a finite number of price changes are allowed. This article is protected by copyright. All rights reserved

A bilateral price negotiation strategy based on Bayesian classification and Q-learning

Reinforcement Learning Negotiation Strategy Based on Opponent Classification

Optimized negotiation strategy based on reinforcement learning

Bayesian Learning in Bilateral Multi-Issue Negotiation and Its Application in Mas-Based Electronic Commerce

Double learning algorithm in bilateral multi-issue negotiation under incomplete information

A Q-learning Approach to Generating Behavior of Emotional Persuasion with Adaptive Time Belief in Decision-making of Agent-based Negotiation

The Two-Stage Negotiation Mechanism Based on Multi-Agent Using Q-learning in Electricity Bilateral Contract

Bargaining strategies in bilateral electricity trading based on fuzzy Bayesian learning

Tri-Training Based Bilateral Multi-Issue Negotiation Framework.

A Human-Computer Negotiation Model Based on Q-Learning

AUTOMATED NEGOTIATION BASED ON ENSEMBLE LEARNING AND OPTIMAL COUNTER PROPOSAL

Research on Reinforcement Learning Negotiation Strategy and Its Optimization

Learnable Strategies for Bilateral Agent Negotiation over Multiple Issues

Automated Negotiation Decision Model Based on Classifier Fusion

MCTS-based Automated Negotiation Agent

A Dynamic Strategy Coach for Effective Negotiation

Dynamic Pricing by Multiagent Reinforcement Learning

A Two-stage Negotiation Strategy Based on Multi-agent Using Q-learning in Direct Power Purchase with Large Consumers

Applying Opponent Modeling for Automatic Bidding in Online Repeated Auctions

Indirect Dynamic Negotiation in the Nash Demand Game

Bayesian dynamic learning and pricing with strategic customers