Abstract:This study introduces an approach to obtain a neighboring extremal optimal control (NEOC) solution for a closed-loop optimal control problem, applicable to a wide array of nonlinear systems and not necessarily quadratic performance indices. The approach involves investigating the variation incurred in the functional form of a known closed-loop optimal control law due to small, known parameter variations in the system equations or the performance index. The NEOC solution can formally be obtained by solving a linear partial differential equation, akin to those encountered in the iterative solution of a nonlinear Hamilton-Jacobi equation. Motivated by numerical procedures for solving these latter equations, we also propose a numerical algorithm based on the Galerkin algorithm, leveraging the use of basis functions to solve the underlying Hamilton-Jacobi equation of the original optimal control problem. The proposed approach simplifies the NEOC problem by reducing it to the solution of a simple set of linear equations, thereby eliminating the need for a full re-solution of the adjusted optimal control problem. Furthermore, the variation to the optimal performance index can be obtained as a function of both the system state and small changes in parameters, allowing the determination of the adjustment to an optimal control law given a small adjustment of parameters in the system or the performance index. Moreover, in order to handle large known parameter perturbations, we propose a homotopic approach that breaks down the single calculation of NEOC into a finite set of multiple steps. Finally, the validity of the claims and theory is supported by theoretical analysis and numerical simulations.

Applying the canonical dual theory in optimal control problems

A primal--dual algorithm as applied to optimal control problems

The dual approach to optimal control in the coefficients of nonlocal nonlinear diffusion

Transforming a nonlinear system to an extended Brunovsky canonical form without feedback

The Nonlocal Kelvin Principle and the Dual Approach to Nonlocal Control in the Conduction Coefficients

Canonical Solutions to Nonconvex Minimization Problems over Lorentz Cone

Optimal Control of Dynamical Systems using Calculus of Variations

A Canonical Dual Approach for Solving Linearly Constrained Quadratic Programs

Canonical Dual Solutions to Quadratic Optimization over One Quadratic Constraint.

Extended Kalman filter -- Koopman operator for tractable stochastic optimal control

Stochastic Linear-quadratic Control Problems with Affine Constraints

Equivalence of Three Different Kinds of Optimal Control Problems for Heat Equations and Its Applications

Neighboring Extremal Optimal Control Theory for Parameter-Dependent Closed-loop Laws

Optimal Control of Semilinear Elliptic Partial Differential Equations with Non-Lipschitzian Nonlinearities

Connection among stochastic Hamilton-Jacobi-Bellman equation, path-integral, and Koopman operator on nonlinear stochastic optimal control

Linear-quadratic optimal control for infinite-dimensional input-state-output systems

Port-Hamiltonian structures in infinite-dimensional optimal control: Primal-Dual gradient method and control-by-interconnection

New Dualities in Linear Systems and Optimal Output Control under Bounded Disturbances

Optimal control under nonconvexity: A generalized Hamiltonian approach

Data-Driven Stochastic Optimal Control using Linear Transfer Operators