Abstract:In this paper, we study multistage stochastic mixed-integer nonlinear programs (MS-MINLP). This general class of problems encompasses, as important special cases, multistage stochastic convex optimization with non-Lipschitzian value functions and multistage stochastic mixed-integer linear optimization. We develop stochastic dual dynamic programming (SDDP) type algorithms with nested decomposition, deterministic sampling, and stochastic sampling. The key ingredient is a new type of cuts based on generalized conjugacy. Several interesting classes of MS-MINLP are identified, where the new algorithms are guaranteed to obtain the global optimum without the assumption of complete recourse. This significantly generalizes the classic SDDP algorithms. We also characterize the iteration complexity of the proposed algorithms. In particular, for a -stage stochastic MINLP satisfying L -exact Lipschitz regularization with d -dimensional state spaces, to obtain an -optimal root node solution, we prove that the number of iterations of the proposed deterministic sampling algorithm is upper bounded by , and is lower bounded by for the general case or by for the convex case. This shows that the obtained complexity bounds are rather sharp. It also reveals that the iteration complexity depends polynomially on the number of stages. We further show that the iteration complexity depends linearly on T , if all the state spaces are finite sets, or if we seek a -optimal solution when the state spaces are infinite sets, i.e. allowing the optimality gap to scale with T . To the best of our knowledge, this is the first work that reports global optimization algorithms as well as iteration complexity results for solving such a large class of multistage stochastic programs. The iteration complexity study resolves a conjecture by the late Prof. Shabbir Ahmed in the general setting of multistage stochastic mixed-integer optimization.

The policy graph decomposition of multistage stochastic programming problems

Stochastic Cubic-Regularized Policy Gradient Method

Markov Chain-based Policies for Multi-stage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics

Optimal Production Control Policy Based on Hierarchical Varying Receding-Horizon

Dynamic Programming on Nominal Graphs

Varying Receding-Horizon Based Production Control for Hybrid Production Systems

A Progressive Hedging-Based Solution Approach for Integrated Planning and Scheduling Problems under Demand Uncertainty

Dual dynamic programming for stochastic programs over an infinite horizon

Column generation for multistage stochastic mixed-integer nonlinear programs with discrete state variables

Technical Report: The Policy Graph Improvement Algorithm

Rolling horizon policies for multi-stage stochastic assemble-to-order problems

The Pareto Optimization Policies of Multi-Stage Group Decision Making

On Solving Optimal Policies for Finite-Stage Event-Based Optimization

Adaptive Multistage Stochastic Programming

Policy Graph Pruning And Optimization In Monte Carlo Value Iteration For Continuous-State Pomdps

On the Performance Bounds of some Policy Search Dynamic Programming Algorithms

Scenario-decomposition Solution Framework for Nonseparable Stochastic Control Problems

An aggregate stochastic dynamic programming model of multireservoir systems

Online policy iteration algorithm for semi-Markov switching state-space control processes

Stochastic dual dynamic programming for multistage stochastic mixed-integer nonlinear optimization

Multiple stage stochastic linear programming with multiple objectives: flexible decision making