Abstract:We study a continuous-review, two-echelon inventory system with one central warehouse, multiple local facilities, and each facility facing random demand. Local facilities replenish their stock from the central warehouse (or distribution center), which in turn places orders at an outside supplier with an ample supply. Inventory replenishment at each location incurs a fixed-plus-variable cost for each shipment. The optimal policy remains unknown, and even if it exists, such a policy must be extremely complicated. Instead, we evaluate a class of easy-to-implement heuristics, called modified echelon (r, Q) policies. The parameters for such a heuristic are obtained by solving a set of independent single-stage systems. We show that the proposed policy is asymptotically optimal, as pairs of system primitives, such as the ratios of the fixed cost of the central facility to those of the local facilities, are scaled up. We also show that as the number of retailers grows, the performance bound of the heuristic converges to a primitive-dependent constant.

A Semimartingale Characterization of Average Optimal Stationary Policies for Markov Decision Processes

On Average Optimality for Non-Stationary Markov Decision Processes in Borel Spaces

Optimal Stationary Policies for a Class of Countable Markov Control Processes

Optimal Stationary Policies for Semi-Markov Control Processes with Discounted-Cost Criteria

Risk-Sensitive Average Markov Decision Processes in General Spaces

Optimization Algorithms for Semi-Markov Control Processes with Average Criteria

Performance Bounds and Asymptotic Optimality of Modified (r, Q) Policies for Stochastic Distribution Inventory Systems

Performance Optimization of Semi-Markov Decision Processes with Discounted-cost Criteria.

Average Optimality in Markov Decision Processes with Unbounded Rewards

Solution to the risk-sensitive average cost optimality equation in a class of Markov decision processes with finite state space

Relations Between Discounted Models and Average Models for Semi-Markov Decision Processes

Average-Cost MDPs with Infinite State and Action Sets: New Sufficient Conditions for Optimality Inequalities and Equations

Analysis for Some Properties of Discrete Time Markov Decision Processes

Average cost optimal control under weak ergodicity hypotheses: Relative value iterations

On Strategic Measures and Optimality Properties in Discrete-Time Stochastic Control with Universally Measurable Policies

Stationary Almost Markov ε-Equilibria for Discounted Stochastic Games with Borel Spaces and Unbounded Payoffs

Mixed Markov Decision Processes in a Semi-Markov Environment with Discounted Criterion

On Linear Programming for Constrained and Unconstrained Average-Cost Markov Decision Processes with Countable Action Spaces and Strictly Unbounded Costs

Performance Optimization for Countable Semi-Markov Decision Processes with Discounted-cost

Towards Analysis Of Semi-Markov Decision Processes

OPTIMALITY STRATEGY OF AVERAGE COST BASED PERFORMANCE POTENTIALS FOR MARKOV CONTROL PROCESS