Abstract:We consider the periodic review dynamic pricing and inventory control problem with fixed ordering cost. Demand is random and price dependent, and unsatisfied demand is backlogged. With complete demand information, the celebrated (s,S,p) policy is proved to be optimal, where s and S are the reorder point and order-up-to level for ordering strategy, and p, a function of on-hand inventory level, characterizes the pricing strategy. In this paper, we consider incomplete demand information and develop online learning algorithms whose average profit approaches that of the optimal (s,S,p) with a tight O(T^(1/2)) regret rate. A number of salient features differentiate our work from the existing online learning researches in the OM literature. First, computing the optimal (s,S,p) policy requires solving a dynamic programming (DP) over multiple periods involving unknown quantities, which is different from the majority of learning problems in operations management that only require solving single-period optimization questions. It is hence challenging to establish stability results through DP recursions, which we accomplish by proving uniform convergence of the profit-to-go function. The necessity of analyzing action-dependent state transition over multiple periods resembles the reinforcement learning question, considerably more difficult than existing bandit learning algorithms. Second, the pricing function p is of infinite dimension, and approaching it is much more challenging than approaching a finite number of parameters as seen in existing researches. The demand-price relationship is estimated based on upper confidence bound, but the confidence interval cannot be explicitly calculated due to the complexity of the DP recursion. Finally, due to the multi-period nature of (s,S,p) policies the actual distribution of the randomness in demand plays an important role in determining the optimal pricing strategy p, which is unknown to the learner a priori. In this paper, the demand randomness is approximated by an empirical distribution constructed using dependent samples, and a novel Wasserstein metric based argument is employed to prove convergence of the empirical distribution.

(S, S) Inventory Systems with Random Lead Times: Harris Recurrence and Its Implications in Sensitivity Analysis

Inventory Optimization of Manufacturing/remanufacturing Hybrid System with Stochastic Leadtime

Production-inventory Control Policy under Warm/cold State-Dependent Fixed Costs and Stochastic Demand: Partial Characterization and Heuristics

Double Smoothed Volatility Estimation of Potentially Non‐stationary Jump‐diffusion Model of Shibor

The Effect of Lead Time and Demand Uncertainties in (r, Q) Inventory Systems

A New Approach to (s, S) Inventory Systems

Exploiting random lead times for significant inventory cost savings

Single-Item Continuous-Review Inventory Models with Random Supplies

An inventory model with stochastic lead-time and stochastic demand.

(S, S) Inventory Systems with Correlated Demands

Inventory management model and sensitivity analysis for stochastic demand

On Properties of Discrete (r, Q) and (s, T) Inventory Systems.

Joint pricing and inventory control for a stochastic inventory system with Brownian motion demand

Dynamic Pricing and Inventory Control with Fixed Ordering Cost and Incomplete Demand Information

Asymptotic Optimality of Tailored Base-Surge Policies in Dual-Sourcing Inventory Systems

Stochastic Setup-Cost Inventory Model With Backorders And Quasiconvex Cost Functions

An (R, S) Based Heuristic Model for the Stochastic Joint Replenishment Problem

Matching Supply and Demand in Production-Inventory Systems: Asymptotics and Optimization

Exact Inventory Cost Model with Random Demands and Lead Time

Managing Inventory and Supply Performance in Assembly Systems with Random Supply Capacity and Demand

Robust Design of (s, S) Inventory Policy Parameters in Supply Chains with Demand and Lead Time Uncertainties