Abstract:We consider the periodic review dynamic pricing and inventory control problem with fixed ordering cost. Demand is random and price dependent, and unsatisfied demand is backlogged. With complete demand information, the celebrated (s,S,p) policy is proved to be optimal, where s and S are the reorder point and order-up-to level for ordering strategy, and p, a function of on-hand inventory level, characterizes the pricing strategy. In this paper, we consider incomplete demand information and develop online learning algorithms whose average profit approaches that of the optimal (s,S,p) with a tight O(T^(1/2)) regret rate. A number of salient features differentiate our work from the existing online learning researches in the OM literature. First, computing the optimal (s,S,p) policy requires solving a dynamic programming (DP) over multiple periods involving unknown quantities, which is different from the majority of learning problems in operations management that only require solving single-period optimization questions. It is hence challenging to establish stability results through DP recursions, which we accomplish by proving uniform convergence of the profit-to-go function. The necessity of analyzing action-dependent state transition over multiple periods resembles the reinforcement learning question, considerably more difficult than existing bandit learning algorithms. Second, the pricing function p is of infinite dimension, and approaching it is much more challenging than approaching a finite number of parameters as seen in existing researches. The demand-price relationship is estimated based on upper confidence bound, but the confidence interval cannot be explicitly calculated due to the complexity of the DP recursion. Finally, due to the multi-period nature of (s,S,p) policies the actual distribution of the randomness in demand plays an important role in determining the optimal pricing strategy p, which is unknown to the learner a priori. In this paper, the demand randomness is approximated by an empirical distribution constructed using dependent samples, and a novel Wasserstein metric based argument is employed to prove convergence of the empirical distribution.

Discrete Price Updates Yield Fast Convergence in Ongoing Markets with Finite Warehouses

Tatonnement in Ongoing Markets of Complementary Goods

Performance Bounds and Asymptotic Optimality of Modified (r, Q) Policies for Stochastic Distribution Inventory Systems

On the Convergence of Tâtonnement for Linear Fisher Markets

Fast and Interpretable Dynamics for Fisher Markets via Block-Coordinate Updates

Tracing Equilibrium in Dynamic Markets via Distributed Adaptation

Stochastic Online Fisher Markets: Static Pricing Limits and Adaptive Enhancements

A Weak Convergence Approach to Inventory Control Using a Long-term Average Criterion

On the Proximity of Markets with Integral Equilibria

Taylor Approximation of Inventory Policies for One-Warehouse, Multi-Retailer Systems with Demand Feature Information

Online Market Equilibrium with Application to Fair Division

Price Interpretability of Prediction Markets: A Convergence Analysis

Infinite-Dimensional Fisher Markets and Tractable Fair Division

Faster Dynamic Auctions via Polymatroid Sum

On Equilibrium Pricing As Convex Optimization

Fisher Equilibrium Price with a Class of Concave Utility Functions

Fast Convergence in the Double Oral Auction

Satiation in Fisher Markets and Approximation of Nash Social Welfare

Market efficiency and the long-memory of supply and demand: Is price impact variable and permanent or fixed and temporary?

Dynamic pricing with multiple consumers and alternating offers under retailer competition: theory and experiment

Dynamic Pricing and Inventory Control with Fixed Ordering Cost and Incomplete Demand Information