Abstract:Adjoint systems are widely used to inform control, optimization, and design in systems described by ordinary differential equations or differential-algebraic equations. In this paper, we explore the geometric properties and develop methods for such adjoint systems. In particular, we utilize symplectic and presymplectic geometry to investigate the properties of adjoint systems associated with ordinary differential equations and differential-algebraic equations, respectively. We show that the adjoint variational quadratic conservation laws, which are key to adjoint sensitivity analysis, arise from (pre)symplecticity of such adjoint systems. We discuss various additional geometric properties of adjoint systems, such as symmetries and variational characterizations. For adjoint systems associated with a differential-algebraic equation, we relate the index of the differential-algebraic equation to the presymplectic constraint algorithm of Gotay et al. [18]. As an application of this geometric framework, we discuss how the adjoint variational quadratic conservation laws can be used to compute sensitivities of terminal or running cost functions. Furthermore, we develop structure-preserving numerical methods for such systems using Galerkin Hamiltonian variational integrators (Leok and Zhang [23]) which admit discrete analogues of these quadratic conservation laws. We additionally show that such methods are natural, in the sense that reduction, forming the adjoint system, and discretization all commute, for suitable choices of these processes. We utilize this naturality to derive a variational error analysis result for the presymplectic variational integrator that we use to discretize the adjoint DAE system. Finally, we discuss the application of adjoint systems in the context of optimal control problems, where we prove a similar naturality result.

Adjoint System in the Shooting Method to Solve Boundary Value Problems

Shooting Methods for Fractional Dirichlet-Type Boundary Value Problems of Order $α\in (1,2)$ With Caputo Derivatives

Advanced numerical scheme and its convergence analysis for a class of two-point singular boundary value problems

A shooting algorithm for problems with singular arcs

Well-posedness of the shooting algorithm for control-affine problems with a scalar state constraint

Approximate solution of system of equations arising in interior-point methods for bound-constrained optimization

A comparison between the Shooting and Finite-Difference Method in solving a Nonlinear Boundary Value Problem found in the context of light propagation

The linearization methods as a basis to derive the relaxation and the shooting methods

A method for solving boundary value problems for nonlinear control systems in the class of discrete controls

Solving nonlinear boundary value problems by a boundary shape function method and a splitting and linearizing method

Numeric-Analytic Form of the Adomian Decomposition Method for Two-Point Boundary Value Problems in Nonlinear Mechanics

On the Approximate Solution of Weakly Nonlinear Boundary-Value Problems by the Newton–Kantorovich Method

Newton's Method Applied to Nonlinear Boundary Value Problems: A Numerical Approach

Adomian decomposition method for solving derivative-dependent doubly singular boundary value problems

Least-squares solutions of boundary-value problems in hybrid systems

Geometric Methods for Adjoint Systems

Solving a Nonlinear System of Second Order Two-Point Boundary Value Problem

Adomian Decomposition Method in the Theory of Nonlinear Boundary-Value Problems

On a general discrete boundary value problem

A degree theory approach for the shooting method

On the accurate discretization of a highly nonlinear boundary value problem