Abstract:This paper provides an overview, analysis, and comparison of second-order dynamic optimization algorithms, i.e., constrained Differential Dynamic Programming (DDP) and Sequential Quadratic Programming (SQP). Although a variety of these algorithms has been proposed and used successfully, there exists a gap in understanding the key differences and advantages, which we aim to provide in this work. For constrained DDP, we choose methods that incorporate nonlinear programming techniques to handle state and control constraints, including Augmented Lagrangian (AL), Interior Point, Primal Dual Augmented Lagrangian (PDAL), and Alternating Direction Method of Multipliers. Both DDP and SQP are provided in single- and multiple-shooting formulations, where constraints that arise from dynamics are encoded implicitly and explicitly, respectively. As a byproduct of the review, we also propose a single-shooting PDAL DDP which is robust to the growth of penalty parameters and performs better than the normal AL variant. We perform extensive numerical experiments on various systems with increasing complexity to investigate the quality of the solutions, the levels of constraint violation, iterations for convergence, and the sensitivity of final solutions with respect to initialization. The results show that DDP often has the advantage of finding better local minima, while SQP tends to achieve better constraint satisfaction. For multiple-shooting formulation, both DDP and SQP can enjoy informed initial guesses, while the latter appears to be more advantageous in complex systems. It is also worth highlighting that DDP provides favorable computational complexity and feedback gains as a byproduct of optimization.

Direct Approaches for PDE-constrained Dynamic Optimization Based on Space–time Orthogonal Collocation on Finite Elements

A Quasi-Sequential Algorithm for PDE-constrained Optimization Based on Space–time Orthogonal Collocation on Finite Elements

Analytical Sensitivity Computation Using Collocation Method with Non-Uniform Mesh Discretisation for Numerical Solutions of Optimal Control Problems

A Novel Analytical Second‐order Sensitivity Calculation Approach Using the Finite Element Method for Chemical Engineering Problems

An Effective Simultaneous Approach with Variable Time Nodes for Dynamic Optimization Problems

An Effective Pseudospectral Method for Constraint Dynamic Optimisation Problems with Characteristic Times

An Adaptive Pseudospectral Method for Constrained Dynamic Optimization Problems in Chemical Engineering

Global Versus Local Orthogonal Collocation in Simultaneous Approach

A Hybrid Dynamic Optimization Approach for Stability Constrained Optimal Power Flow

A simulation-based approach for solving optimisation problems with ODE-type steady state constraints

An Effective Dynamic Optimization Method Based on Modified Orthogonal Collocation and Reduced SQP

Dynamic optimization of nonlinear differential game problems using orthogonal collocation with analytical sensitivities

A Parallel Reduced-Space Interior Point Method With Orthogonal Collocation for First-Swing Stability Constrained Emergency Control

An Improved Finite Element Meshing Strategy for Dynamic Optimization Problems

Distributed discrete-time convex optimization with nonidentical local constraints over time-varying unbalanced directed graphs

Safety Envelope for Orthogonal Collocation Methods in Embedded Optimal Control

Dynamic Optimization Using Control Vector Parameterization With State Transition Algorithm

Improved orthogonal collocation method and its application to dynamic optimization problems of chemical process

Global Optimization with Orthogonality Constraints Via Stochastic Diffusion on Manifold

Second-Order Constrained Dynamic Optimization

Distributed Continuous-Time Algorithm for Time-Varying Optimization With Affine Formation Constraints