Abstract:In this paper, we study multistage stochastic mixed-integer nonlinear programs (MS-MINLP). This general class of problems encompasses, as important special cases, multistage stochastic convex optimization with non-Lipschitzian value functions and multistage stochastic mixed-integer linear optimization. We develop stochastic dual dynamic programming (SDDP) type algorithms with nested decomposition, deterministic sampling, and stochastic sampling. The key ingredient is a new type of cuts based on generalized conjugacy. Several interesting classes of MS-MINLP are identified, where the new algorithms are guaranteed to obtain the global optimum without the assumption of complete recourse. This significantly generalizes the classic SDDP algorithms. We also characterize the iteration complexity of the proposed algorithms. In particular, for a -stage stochastic MINLP satisfying L -exact Lipschitz regularization with d -dimensional state spaces, to obtain an -optimal root node solution, we prove that the number of iterations of the proposed deterministic sampling algorithm is upper bounded by , and is lower bounded by for the general case or by for the convex case. This shows that the obtained complexity bounds are rather sharp. It also reveals that the iteration complexity depends polynomially on the number of stages. We further show that the iteration complexity depends linearly on T , if all the state spaces are finite sets, or if we seek a -optimal solution when the state spaces are infinite sets, i.e. allowing the optimality gap to scale with T . To the best of our knowledge, this is the first work that reports global optimization algorithms as well as iteration complexity results for solving such a large class of multistage stochastic programs. The iteration complexity study resolves a conjecture by the late Prof. Shabbir Ahmed in the general setting of multistage stochastic mixed-integer optimization.

Regularized stochastic dual dynamic programming for convex nonlinear optimization problems

Inexact cuts in Deterministic and Stochastic Dual Dynamic Programming applied to linear optimization problems

Inexact cuts for Deterministic and Stochastic Dual Dynamic Programming applied to convex nonlinear optimization problems

Online Distributed Optimization with Nonconvex Objective Functions Via Dynamic Regrets

Solving the Dual Problems of Dynamic Programs via Regression

Two-Stage Stochastic Programming with Linearly Bi-parameterized Quadratic Recourse.

On Stochastic Primal-Dual Hybrid Gradient Approach for Compositely Regularized Minimization.

Gradient-Bounded Dynamic Programming with Submodular and Concave Extensible Value Functions

Accelerating Primal-Dual Methods for Regularized Markov Decision Processes

Scaling up stochastic gradient descent for non-convex optimisation

Stochastic dual dynamic programming for multistage stochastic mixed-integer nonlinear optimization

Second-Order Constrained Dynamic Optimization

Optimal Regularized Online Allocation by Adaptive Re-Solving

On conditional cuts for Stochastic Dual Dynamic Programming

Gradient Accelerated Stochastic Dual Dynamic Programming for Economic Dispatch in Microgrids with Energy Storages

Faster Differentially Private Convex Optimization via Second-Order Methods

Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs

Regularized online exponentially concave optimization

High Probability and Risk-Averse Guarantees for a Stochastic Accelerated Primal-Dual Method

Stochastic Dynamic Cutting Plane for Multistage Stochastic Convex Programs

Information Relaxation and A Duality-Driven Algorithm for Stochastic Dynamic Programs