Abstract:Multi-stage stochastic programming is a well-established framework for sequential decision making under uncertainty by seeking policies that are fully adapted to the uncertainty. Often such flexible policies are not desirable, and the decision maker may need to commit to a set of actions for a number of planning periods. Two-stage stochastic programming might be better suited to such settings, where the decisions for all periods are made here-and-now and do not adapt to the uncertainty realized. In this paper, we propose a novel alternative approach, where the stages are not predetermined but part of the optimization problem. Each component of the decision policy has an associated revision point, a period prior to which the decision is predetermined and after which it is revised to adjust to the uncertainty realized thus far. We motivate this setting using the multi-period newsvendor problem by deriving an optimal adaptive policy. We label the proposed approach as adaptive two-stage stochastic programming and provide a generic mixed-integer programming formulation for finite stochastic processes. We show that adaptive two-stage stochastic programming is NP-hard in general. Next, we derive bounds on the value of adaptive two-stage programming in comparison to the two-stage and multi-stage approaches for a specific problem structure inspired by the capacity expansion planning problem. Since directly solving the mixed-integer linear program associated with the adaptive two-stage approach might be very costly for large instances, we propose several heuristic solution algorithms based on the bound analysis. We provide approximation guarantees for these heuristics. Finally, we present an extensive computational study on an electricity generation capacity expansion planning problem and demonstrate the computational and practical impacts of the proposed approach from various perspectives.

An Approximate Dynamic Programming Algorithm for Multi-Stage Capacity Investment Problems.

A Chance Constrained Programming Approach for Multi-Product Multi-Stage Integrated Production Planning under Internal and External Uncertainties

Modeling and Optimizing Resource Allocation Decisions through Multi-model Markov Decision Processes with Capacity Constraints

Adaptive Two-stage Stochastic Programming with an Analysis on Capacity Expansion Planning Problem

On the Value of Risk-Averse Multistage Stochastic Programming in Capacity Planning

A Flexible Multi-Facility Capacity Expansion Problem with Risk Aversion

Two-stage stochastic programming for the inventory routing problem with stochastic demands in fuel delivery

Multi-supply multi-capacitated p-median location optimization via a hybrid bi-level intelligent algorithm

Dual dynamic programming for multi-scale mixed-integer MPC

Capacitated Dynamic Lot Sizing With Capacity Acquisition

An Interval-Parameter Chance-Constrained Dynamic Programming Approach for Capacity Planning under Uncertainty

An approximate dynamic programming approach to the admission control of elective patients

An MIP-based Interval Heuristic for the Capacitated Multi-Level Lot-Sizing Problem with Setup Times.

Approximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

Approximate Dynamic Programming with Feasibility Guarantees

A Potential-Based Method for Finite-Stage Markov Decision Process

A Hybrid Lagrangian-simulated Annealing-Based Heuristic for the Parallel-Machine Capacitated Lot-Sizing and Scheduling Problem with Sequence-Dependent Setup Times

Mip-Based Fix-And-Optimise Algorithms for the Parallel Machine Capacitated Lot-Sizing and Scheduling Problem

MIP based fix-and-optimize algorithm for parallel machine lot sizing and scheduling

Markov Decision Process and Approximate Dynamic Programming for a Patient Assignment Scheduling problem

Capacity-Aware Planning and Scheduling in Budget-Constrained Monotonic MDPs: A Meta-RL Approach