Abstract:Inventory management problems with periodic and controllable resets occur in the context of managing water storage in the developing world and retailing limited-time availability products. In this paper, we consider a set of sequential decision problems in which the decision-maker must not only balance holding and shortage costs but discard all inventory before a fixed number of decision epochs, with the option for an early inventory reset. Finding optimal policies using dynamic programming for these problems is particularly challenging since the resulting value functions are non-convex. Moreover, this structure cannot be easily analyzed using existing extended definitions, such as $K$-convexity. Our key contribution is to present sufficient conditions that ensure the optimal policy has an easily interpretable structure that generalizes the well-known $(s, S)$ policy from the operations literature. Furthermore, we demonstrate that the optimal policy has a four-threshold structure under these rather mild conditions. We then conclude with computational experiments, thereby illustrating the policy structures that can be extracted in several inventory management scenarios.

What problem does this paper attempt to address?

This paper attempts to address the problem of how to formulate an optimal strategy to balance holding costs, shortage costs, and safety constraints in inventory management when products have a fixed shelf life and expired products cannot be handled separately. Specifically, the paper focuses on decision-making issues in scenarios where all inventory must be cleared within a certain period, such as in household water storage management in developing countries and inventory management of products with limited-time supply in retail, where inventory needs to be reset periodically or on demand. ### Background and Problem Description 1. **Inventory Management Problem**: Traditional inventory management models mainly focus on balancing holding costs (the cost of holding too much inventory) and shortage costs (the cost of not meeting demand). However, when products have shelf life limitations or are subject to strict safety regulations, the assumptions of these traditional models no longer apply. 2. **Specific Application Scenarios**: - **Household Water Storage Management**: In developing countries, many households rely on intermittent water supply and thus need to store water at home. However, water stored for a long time can become contaminated, requiring regular emptying of water tanks to ensure water quality safety. - **Retail Inventory Management**: In the retail industry, seasonal and fashion trends lead to highly fluctuating product demand. To adapt to new market demands, old product lines must be completely cleared to introduce new product lines. ### Main Contributions of the Paper 1. **Theoretical Analysis**: The paper proposes sufficient conditions to ensure that the optimal strategy has an easily interpretable structure, which can be seen as an extension of the classic (s, S) policy. Specifically, the paper proves that under certain mild conditions, the optimal strategy has a four-threshold structure. 2. **Algorithm Design**: The paper proposes a new algorithm—the Binary Dynamic Search Algorithm (BiDS)—for solving stochastic optimal control problems with reset control. Compared to traditional value iteration and policy iteration methods, the BiDS algorithm demonstrates higher computational efficiency in low-dimensional state spaces. 3. **Numerical Experiments**: Through numerical experiments, the paper validates the proposed strategy structure and demonstrates the extracted strategy structure in different inventory management scenarios. ### Conclusion Through theoretical analysis and numerical experiments, the paper provides new solutions for inventory management problems with fixed shelf life and where expired products cannot be handled separately. These solutions are applicable not only to non-profit household water storage management but also to retail inventory management, helping enterprises optimize costs while ensuring safety.

Optimal Policy for Inventory Management with Periodic and Controlled Resets