Abstract:We consider the periodic review dynamic pricing and inventory control problem with fixed ordering cost. Demand is random and price dependent, and unsatisfied demand is backlogged. With complete demand information, the celebrated (s,S,p) policy is proved to be optimal, where s and S are the reorder point and order-up-to level for ordering strategy, and p, a function of on-hand inventory level, characterizes the pricing strategy. In this paper, we consider incomplete demand information and develop online learning algorithms whose average profit approaches that of the optimal (s,S,p) with a tight O(T^(1/2)) regret rate. A number of salient features differentiate our work from the existing online learning researches in the OM literature. First, computing the optimal (s,S,p) policy requires solving a dynamic programming (DP) over multiple periods involving unknown quantities, which is different from the majority of learning problems in operations management that only require solving single-period optimization questions. It is hence challenging to establish stability results through DP recursions, which we accomplish by proving uniform convergence of the profit-to-go function. The necessity of analyzing action-dependent state transition over multiple periods resembles the reinforcement learning question, considerably more difficult than existing bandit learning algorithms. Second, the pricing function p is of infinite dimension, and approaching it is much more challenging than approaching a finite number of parameters as seen in existing researches. The demand-price relationship is estimated based on upper confidence bound, but the confidence interval cannot be explicitly calculated due to the complexity of the DP recursion. Finally, due to the multi-period nature of (s,S,p) policies the actual distribution of the randomness in demand plays an important role in determining the optimal pricing strategy p, which is unknown to the learner a priori. In this paper, the demand randomness is approximated by an empirical distribution constructed using dependent samples, and a novel Wasserstein metric based argument is employed to prove convergence of the empirical distribution.

Real time decision rule for online retailer on partial backordering

A real-time decision rule for an inventory system with committed service time and emergency orders.

Production-inventory Control Policy under Warm/cold State-Dependent Fixed Costs and Stochastic Demand: Partial Characterization and Heuristics

Performance Bounds and Asymptotic Optimality of Modified (r, Q) Policies for Stochastic Distribution Inventory Systems

Managing Retail Shelf and Backroom Inventories when Demand Depends on the Shelf‐Stock Level

Inventory Rationing In A Capacitated System With Backorders And Lost Sales

Inventory Management In A (Q,R) Inventory Model With Two Demand Classes And Flexible Delivery

Coping with Demand Uncertainty: The Interplay between Dual Sourcing and Endogenous Partial Backordering

Partial Backorder Inventory System: Asymptotic Optimality and Demand Learning

A Partial Backorder Inventory System with Quoted Service Time

Optimal Pricing and Ordering Decisions with Reference Effect and Quick Replenishment Policy

An Inventory Systemwith Quasi-Hyperbolic Discounting Rate

Putting Off the Catching Up: Online Joint Replenishment Problem with Holding and Backlog Costs

Optimal Admission Polices for A Retailer of Seasonal Products with Drop-Shipping

Dynamic Pricing and Inventory Control with Fixed Ordering Cost and Incomplete Demand Information

Coordinating Inventory and Pricing Decisions with General Price‐Dependent Demands

Pricing and Inventory Management in a System with Multiple Competing Retailers under (r, Q) Policies.

The optimal decision of risk-averse retailer under time-sensitive and price-sensitive demand

Learning to Order for Inventory Systems with Lost Sales and Uncertain Supplies

Joint optimization of inventory replenishment and rationing policies for an omnichannel store with both in-store and online demands

Continuous Review Inventory System under Advance Sales Discount, Partial Backordering and Trade Credits