Abstract:This paper provides an overview, analysis, and comparison of second-order dynamic optimization algorithms, i.e., constrained Differential Dynamic Programming (DDP) and Sequential Quadratic Programming (SQP). Although a variety of these algorithms has been proposed and used successfully, there exists a gap in understanding the key differences and advantages, which we aim to provide in this work. For constrained DDP, we choose methods that incorporate nonlinear programming techniques to handle state and control constraints, including Augmented Lagrangian (AL), Interior Point, Primal Dual Augmented Lagrangian (PDAL), and Alternating Direction Method of Multipliers. Both DDP and SQP are provided in single- and multiple-shooting formulations, where constraints that arise from dynamics are encoded implicitly and explicitly, respectively. As a byproduct of the review, we also propose a single-shooting PDAL DDP which is robust to the growth of penalty parameters and performs better than the normal AL variant. We perform extensive numerical experiments on various systems with increasing complexity to investigate the quality of the solutions, the levels of constraint violation, iterations for convergence, and the sensitivity of final solutions with respect to initialization. The results show that DDP often has the advantage of finding better local minima, while SQP tends to achieve better constraint satisfaction. For multiple-shooting formulation, both DDP and SQP can enjoy informed initial guesses, while the latter appears to be more advantageous in complex systems. It is also worth highlighting that DDP provides favorable computational complexity and feedback gains as a byproduct of optimization.

Optimizing Trajectories with Closed-Loop Dynamic SQP

Improved Sequential Convex Programming Based on Pseudospectral Discretization for Entry Trajectory Optimization

Second-Order Constrained Dynamic Optimization

A Sequential Quadratic Programming Approach to the Solution of Open-Loop Generalized Nash Equilibria for Autonomous Racing

Trajectory optimization of autonomous driving by differential dynamic programming

On-Road Trajectory Planning With Spatio-Temporal Rrt* And Always-Feasible Quadratic Program

Entry Optimization Computation Using Simplex Algorithm Reference Trajectory Programming

A variant to Sequential Quadratic Programming for nonlinear Model Predictive Control

Guided Policy Search using Sequential Convex Programming for Initialization of Trajectory Optimization Algorithms

Finding Better Robot Trajectory by Linear Constrained Quadratic Programming

Constraint Handling in Continuous-Time DDP-Based Model Predictive Control

Sequential quadratic programming methods for parametric nonlinear optimization

Differentiable Optimal Control via Differential Dynamic Programming

Generalizing Trajectory Retiming to Quadratic Objective Functions

Time-Optimal Trajectory Generation for Dynamic Vehicles: A Bilevel Optimization Approach.

Descent Property in Sequential Second-Order Cone Programming for Nonlinear Trajectory Optimization

Trajectory Optimization Algorithm Studies

Application of SQP to Optimal Midcourse Guidance

Constrained Trajectory Optimization for Hybrid Dynamical Systems

Multi-Shooting Differential Dynamic Programming for Hybrid Systems using Analytical Derivatives

A three-stage sequential convex programming approach for trajectory optimization