Abstract:We consider the periodic review dynamic pricing and inventory control problem with fixed ordering cost. Demand is random and price dependent, and unsatisfied demand is backlogged. With complete demand information, the celebrated (s,S,p) policy is proved to be optimal, where s and S are the reorder point and order-up-to level for ordering strategy, and p, a function of on-hand inventory level, characterizes the pricing strategy. In this paper, we consider incomplete demand information and develop online learning algorithms whose average profit approaches that of the optimal (s,S,p) with a tight O(T^(1/2)) regret rate. A number of salient features differentiate our work from the existing online learning researches in the OM literature. First, computing the optimal (s,S,p) policy requires solving a dynamic programming (DP) over multiple periods involving unknown quantities, which is different from the majority of learning problems in operations management that only require solving single-period optimization questions. It is hence challenging to establish stability results through DP recursions, which we accomplish by proving uniform convergence of the profit-to-go function. The necessity of analyzing action-dependent state transition over multiple periods resembles the reinforcement learning question, considerably more difficult than existing bandit learning algorithms. Second, the pricing function p is of infinite dimension, and approaching it is much more challenging than approaching a finite number of parameters as seen in existing researches. The demand-price relationship is estimated based on upper confidence bound, but the confidence interval cannot be explicitly calculated due to the complexity of the DP recursion. Finally, due to the multi-period nature of (s,S,p) policies the actual distribution of the randomness in demand plays an important role in determining the optimal pricing strategy p, which is unknown to the learner a priori. In this paper, the demand randomness is approximated by an empirical distribution constructed using dependent samples, and a novel Wasserstein metric based argument is employed to prove convergence of the empirical distribution.

On Data-Driven Multi-Product Pricing

Online Learning and Pricing for Multiple Products with Reference Price Effects

The Big Data Newsvendor Problem under Demand and Yield Uncertainties

Nonparametric Multi-Product Dynamic Pricing with Demand Learning Via Simultaneous Price Perturbation

Policy Optimization Using Semi-parametric Models for Dynamic Pricing

Dynamic Pricing with Parametric Demand Learning and Reference-Price Effects

Close the Gaps: A Learning-while-Doing Algorithm for a Class of Single-Product Revenue Management Problems

Nonparametric Learning Algorithms for Joint Pricing and Inventory Control with Lost Sales and Censored Demand

Multi-product pricing method based on the customer buying behavior

Price Optimization Combining Conjoint Data and Purchase History: A Causal Modeling Approach

Parametric Demand Learning with Limited Price Explorations in a Backlog Stochastic Inventory System

Capacity and Pricing Management with Demand Learning

Dynamic Pricing and Inventory Control with Fixed Ordering Cost and Incomplete Demand Information

Online Pricing with Offline Data: Phase Transition and Inverse Square Law

Dynamic Pricing and Learning with Long-term Reference Effects

High-Dimensional Dynamic Pricing under Non-Stationarity: Learning and Earning with Change-Point Detection

Coordinating Pricing and Inventory Replenishment with Nonparametric Demand Learning

A Primal-dual Learning Algorithm for Personalized Dynamic Pricing with an Inventory Constraint

Optimization Beyond Prediction: Prescriptive Price Optimization

Dynamic Pricing and Advertising with Demand Learning

Multi-product Pricing Method Based on Min-buying Pattern