Abstract:We introduce two block coordinate descent algorithms for solving optimization problems with ordinary differential equations (ODEs) as dynamical constraints. The algorithms do not need to implement direct or adjoint sensitivity analysis methods to evaluate loss function gradients. They results from reformulation of the original problem as an equivalent optimization problem with equality constraints. The algorithms naturally follow from steps aimed at recovering the gradient-decent algorithm based on ODE solvers that explicitly account for sensitivity of the ODE solution. In our first proposed algorithm we avoid explicitly solving the ODE by integrating the ODE solver as a sequence of implicit constraints. In our second algorithm, we use an ODE solver to reset the ODE solution, but no direct are adjoint sensitivity analysis methods are used. Both algorithm accepts mini-batch implementations and show significant efficiency benefits from GPU-based parallelization. We demonstrate the performance of the algorithms when applied to learning the parameters of the Cucker-Smale model. The algorithms are compared with gradient descent algorithms based on ODE solvers endowed with sensitivity analysis capabilities, for various number of state size, using Pytorch and Jax implementations. The experimental results demonstrate that the proposed algorithms are at least 4x faster than the Pytorch implementations, and at least 16x faster than Jax implementations. For large versions of the Cucker-Smale model, the Jax implementation is thousands of times faster than the sensitivity analysis-based implementation. In addition, our algorithms generate more accurate results both on training and test data. Such gains in computational efficiency is paramount for algorithms that implement real time parameter estimations, such as diagnosis algorithms.

Optimization Algorithm Synthesis based on Integral Quadratic Constraints: A Tutorial

A Tutorial on a Lyapunov-Based Approach to the Analysis of Iterative Optimization Algorithms

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Accelerated Optimization in Deep Learning with a Proportional-Integral-derivative Controller

A discrete adjoint gradient approach for equality and inequality constraints in dynamics

Time-Varying Feedback Optimization for Quadratic Programs with Heterogeneous Gradient Step Sizes

Tutorials on Advanced Optimization Methods

A Stochastic Inexact Sequential Quadratic Optimization Algorithm for Nonlinear Equality-Constrained Optimization

Adjoint-Based Design Optimization of Stability Constrained Systems

Optimization Of Dynamic Systems With Rigorous Path Constraint Satisfaction

Differentiable Optimal Control via Differential Dynamic Programming

Synthesis of a Regulator for a Linear-Quadratic Optimal Control Problem

A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians

Optimizing Optimizers: Regret-optimal gradient descent algorithms

Dynamic Optimization of Nonlinear Systems with Guaranteed Feasibility of Inequality-Path-constraints

Approximation of optimization problems with constraints through kernel Sum-Of-Squares

Genetic Algorithm-Accelerated Optimization for Runge-Kutta Scheme Derivation in High-Dimensional Problems With Hard Constraints

Improving the Efficiency of Gradient Descent Algorithms Applied to Optimization Problems with Dynamical Constraints

Adaptive Quadratic Optimisation with Application to Kinematic Control of Redundant Robot Manipulators

A Proximal-Gradient Method for Constrained Optimization

Tutorial Problems for Nonsmooth Dynamics and Optimal Control: Ski Jumping and Accelerating a Bike Without Pedaling