Abstract:In this paper, we study multistage stochastic mixed-integer nonlinear programs (MS-MINLP). This general class of problems encompasses, as important special cases, multistage stochastic convex optimization with non-Lipschitzian value functions and multistage stochastic mixed-integer linear optimization. We develop stochastic dual dynamic programming (SDDP) type algorithms with nested decomposition, deterministic sampling, and stochastic sampling. The key ingredient is a new type of cuts based on generalized conjugacy. Several interesting classes of MS-MINLP are identified, where the new algorithms are guaranteed to obtain the global optimum without the assumption of complete recourse. This significantly generalizes the classic SDDP algorithms. We also characterize the iteration complexity of the proposed algorithms. In particular, for a -stage stochastic MINLP satisfying L -exact Lipschitz regularization with d -dimensional state spaces, to obtain an -optimal root node solution, we prove that the number of iterations of the proposed deterministic sampling algorithm is upper bounded by , and is lower bounded by for the general case or by for the convex case. This shows that the obtained complexity bounds are rather sharp. It also reveals that the iteration complexity depends polynomially on the number of stages. We further show that the iteration complexity depends linearly on T , if all the state spaces are finite sets, or if we seek a -optimal solution when the state spaces are infinite sets, i.e. allowing the optimality gap to scale with T . To the best of our knowledge, this is the first work that reports global optimization algorithms as well as iteration complexity results for solving such a large class of multistage stochastic programs. The iteration complexity study resolves a conjecture by the late Prof. Shabbir Ahmed in the general setting of multistage stochastic mixed-integer optimization.

Toward Breaking the Curse of Dimensionality: An FPTAS for Stochastic Dynamic Programs with Multidimensional Actions and Scalar States

A PTAS for a Class of Stochastic Dynamic Programs.

Direct Approaches for PDE-constrained Dynamic Optimization Based on Space–time Orthogonal Collocation on Finite Elements

The Parametric Cost Function Approximation: A new approach for multistage stochastic programming

A Fully Polynomial Time Approximation Scheme for Constrained MDPs and Stochastic Shortest Path under Local Transitions

FPTAS for Mixed-Strategy Nash Equilibria in Tree Graphical Games and Their Generalizations

Bounding Procedures for Stochastic Dynamic Programs with Application to the Perimeter Patrol Problem

High-Dimensional Stochastic Optimal Control using Continuous Tensor Decompositions

An approximation algorithm for a general class of multi-parametric optimization problems

Approximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

A PTAS for the Steiner Forest Problem in Doubling Metrics

Stochastic iterative dynamic programming: a Monte Carlo approach to dual control

FPT Approximations for Packing and Covering Problems Parameterized by Elimination Distance and Even Less

A multi-parametric programming approach for constrained dynamic programming problems

A Moment and Sum-of-Squares Extension of Dual Dynamic Programming with Application to Nonlinear Energy Storage Problems

Stochastic Finite State Control of POMDPs with LTL Specifications

Dynamic Programs on Partially Ordered Sets

Complexity of stochastic dual dynamic programming

Dual dynamic programming for stochastic programs over an infinite horizon

Deterministic Policies for Constrained Reinforcement Learning in Polynomial Time

Stochastic dual dynamic programming for multistage stochastic mixed-integer nonlinear optimization