An Introduction to Adjoint Problems

Paolo Luchini,Alessandro Bottaro

DOI: https://doi.org/10.1146/annurev-fluid-010313-141253

2024-04-26

Abstract:Originally published as a Supplemental Appendix to Adjoint Equations in Stability Analysis, Annu. Rev. Fluid Mech. 46:493-517 (2014)

Fluid Dynamics

What problem does this paper attempt to address?

An Automatic Adjoint Theorem and Its Applications

JD Wu,SJ Lu

DOI: https://doi.org/10.1090/s0002-9939-01-06285-2

IF: 0.9709

2001-01-01

Proceedings of the American Mathematical Society

Abstract:In this paper, we prove the following automatic adjoint theorem: For any sequence spaces E ( X ) E(X) and F ( Y ) F(Y) , if E ( X ) E(X) has the signed-weak gliding hump property and A A is an infinite matrix which transforms E ( X ) E(X) into F ( Y ) F(Y) , then the transpose matrix A ′ A’ of A A transforms F ( Y ) β F(Y)^\beta into E ( X ) β E(X)^\beta , and for any x ∈ E ( X ) x\in E(X) and T ∈ F ( Y ) β T\in F(Y)^\beta , [ A x , T ] = [ x , A ′ T ] [Ax,T]=[x,A’T] . That is, the adjoint operator of A A automatically exists and is just the transpose matrix A ′ A’ of A A . From the theorem we obtain a class of infinite matrix topological algebras ( λ , μ ) (\lambda ,\mu ) , and prove also a λ \lambda -multiplier convergence theorem of Orlicz-Pettis type. The theorem improves substantially the famous Stiles’ Orlicz-Pettis theorem.
Geometric Methods for Adjoint Systems

Brian Tran,Melvin Leok

DOI: https://doi.org/10.1007/s00332-023-09999-7

2023-11-07

Abstract:Adjoint systems are widely used to inform control, optimization, and design in systems described by ordinary differential equations or differential-algebraic equations. In this paper, we explore the geometric properties and develop methods for such adjoint systems. In particular, we utilize symplectic and presymplectic geometry to investigate the properties of adjoint systems associated with ordinary differential equations and differential-algebraic equations, respectively. We show that the adjoint variational quadratic conservation laws, which are key to adjoint sensitivity analysis, arise from (pre)symplecticity of such adjoint systems. We discuss various additional geometric properties of adjoint systems, such as symmetries and variational characterizations. For adjoint systems associated with a differential-algebraic equation, we relate the index of the differential-algebraic equation to the presymplectic constraint algorithm of Gotay et al. [18]. As an application of this geometric framework, we discuss how the adjoint variational quadratic conservation laws can be used to compute sensitivities of terminal or running cost functions. Furthermore, we develop structure-preserving numerical methods for such systems using Galerkin Hamiltonian variational integrators (Leok and Zhang [23]) which admit discrete analogues of these quadratic conservation laws. We additionally show that such methods are natural, in the sense that reduction, forming the adjoint system, and discretization all commute, for suitable choices of these processes. We utilize this naturality to derive a variational error analysis result for the presymplectic variational integrator that we use to discretize the adjoint DAE system. Finally, we discuss the application of adjoint systems in the context of optimal control problems, where we prove a similar naturality result.

Optimization and Control,Numerical Analysis,Symplectic Geometry
Three-Dimensional Aerodynamic Design Optimization of A Turbine Blade by Using an Adjoint Method

Jiaqi Luo,Juntao Xiong,Feng Liu,Ivan McBean

DOI: https://doi.org/10.1115/1.4001166

2010-01-01

Journal of Turbomachinery

Abstract:This paper presents the application of an adjoint method to the aerodynamic design optimization of a turbine blade. With the adjoint method, the complete gradient information needed for optimization can be obtained by solving the governing flow equations and their corresponding adjoint equations only once, regardless of the number of design parameters. The formulations including imposition of appropriate boundary conditions for the adjoint equations of the Euler equations for turbomachinery problems are presented. Two design cases are demonstrated for a turbine cascade that involves a high tip flare, characteristic of steam turbine blading in low pressure turbines. The results demonstrate that the design optimization method is effective and the redesigned blade yielded weaker shock and compression waves in the supersonic region of the flow while satisfying the specified constraint. The relative effects of changing blade profile stagger, modifying the blade profile shape, and changing both stagger and profile shape at the same time are examined and compared. Navier-Stokes calculations are performed to confirm the performance at both the design and off-design conditions of the designed blade profile by the Euler method.
Aerodynamic Design Optimization by Using a Continuous Adjoint Method

JiaQi Luo,JunTao Xiong,Feng Liu

DOI: https://doi.org/10.1007/s11433-014-5479-0

2014-01-01

Science China Physics Mechanics and Astronomy

Abstract:This paper presents the fundamentals of a continuous adjoint method and the applications of this method to the aerodynamic design optimization of both external and internal flows.General formulation of the continuous adjoint equations and the corresponding boundary conditions are derived.With the adjoint method,the complete gradient information needed in the design optimization can be obtained by solving the governing flow equations and the corresponding adjoint equations only once for each cost function,regardless of the number of design parameters.An inverse design of airfoil is firstly performed to study the accuracy of the adjoint gradient and the effectiveness of the adjoint method as an inverse design method.Then the method is used to perform a series of single and multiple point design optimization problems involving the drag reduction of airfoil,wing,and wing-body configuration,and the aerodynamic performance improvement of turbine and compressor blade rows.The results demonstrate that the continuous adjoint method can efficiently and significantly improve the aerodynamic performance of the design in a shape optimization problem.
Partially adjoint discretizations of adjoint operators and nonconforming finite element exterior calculus

Shuo Zhang

DOI: https://doi.org/10.48550/arXiv.2206.12114

2022-09-01

Abstract:This paper concerns the discretizations in pair of adjoint operators between Hilbert spaces so that the adjoint properties can be preserved. Due to the finite-dimensional essence of discretized operators, a new framework, theory of partially adjoint operators, is motivated and presented in this paper, so that adjoint properties can be figured out for finite-dimensional operators which can not be non-trivially densely defined in other background spaces. A formal methodology is presented under the framework to construct partially adjoint discretizations by a conforming discretization (CD) and an accompanied-by-conforming discretization (ABCD) for each of the operators. Moreover, the methodology leads to an asymptotic uniformity of an infinite family of finite-dimensional operators. The validities of the theoretical framework and the formal construction of discretizations are illustrated by a systematic family of in-pair discretizations of the adjoint exterior differential operators. The adjoint properties concerned in the paper are the closed range theorem and the strong dualities, whose preservations have not been well studied yet. Quantified versions of the closed range theorem are established for both adjoint operators and partially adjoint discretizations. The notion Poincare-Alexander-Lefschetz (P-A-L for short) type duality is borrowed for operator theory, and horizontal and vertical P-A-L dualities are figured out for adjoint operators and their analogues are established for partially adjoint discretizations. Particularly by partially adjoint discretizations of exterior differential operators, the Poincare-Lefschetz duality is preserved as an identity, which was not yet obtained before.

Numerical Analysis,Functional Analysis
An Adjoint Method for a High-Order Discretization of Deforming Domain Conservation Laws for Optimization of Flow Problems

Matthew J. Zahr,Per-Olof Persson

DOI: https://doi.org/10.1016/j.jcp.2016.09.012

2016-09-19

Abstract:The fully discrete adjoint equations and the corresponding adjoint method are derived for a globally high- order accurate discretization of conservation laws on parametrized, deforming domains. The conservation law on the deforming domain is transformed into one on a fixed reference domain by the introduction of a time-dependent mapping that encapsulates the domain deformation and parametrization, resulting in an Arbitrary Lagrangian-Eulerian form of the governing equations. A high-order discontinuous Galerkin method is used to discretize the transformed equation in space and a high-order diagonally implicit Runge- Kutta scheme is used for the temporal discretization. Quantities of interest that take the form of space-time integrals are discretized in a solver-consistent manner. The corresponding fully discrete adjoint method is used to compute exact gradients of quantities of interest along the manifold of solutions of the fully discrete conservation law. The adjoint method is used to solve two optimal shape and control problems governed by the isentropic, compressible Navier-Stokes equations. The first optimization problem seeks the energetically optimal trajectory of a 2D airfoil given a required initial and final spatial position. The optimization solver, driven by gradients computed via the adjoint method, reduced the total energy required to complete the specified mission nearly an order of magnitude. The second optimization problem seeks the energetically optimal flapping motion and time-morphed geometry of a 2D airfoil given an equality constraint on the x-directed impulse generated on the airfoil. The optimization solver satisfied the impulse constraint to greater than 8 digits of accuracy and reduced the required energy between a factor of 2 and 10, depending on the value of the impulse constraint, as compared to the nominal configuration.

Optimization and Control,Dynamical Systems
A discrete adjoint gradient approach for equality and inequality constraints in dynamics

Daniel Lichtenecker,Karin Nachbagauer

DOI: https://doi.org/10.1007/s11044-024-09965-5

IF: 3.4

2024-01-30

Multibody System Dynamics

Abstract:The optimization of multibody systems requires accurate and efficient methods for sensitivity analysis. The adjoint method is probably the most efficient way to analyze sensitivities, especially for optimization problems with numerous optimization variables. This paper discusses sensitivity analysis for dynamic systems in gradient-based optimization problems. A discrete adjoint gradient approach is presented to compute sensitivities of equality and inequality constraints in dynamic simulations. The constraints are combined with the dynamic system equations, and the sensitivities are computed straightforwardly by solving discrete adjoint algebraic equations. The computation of these discrete adjoint gradients can be easily adapted to deal with different time integrators. This paper demonstrates discrete adjoint gradients for two different time-integration schemes and highlights efficiency and easy applicability. The proposed approach is particularly suitable for problems involving large-scale models or high-dimensional optimization spaces, where the computational effort of computing gradients by finite differences can be enormous. Three examples are investigated to validate the proposed discrete adjoint gradient approach. The sensitivity analysis of an academic example discusses the role of discrete adjoint variables. The energy optimal control problem of a nonlinear spring pendulum is analyzed to discuss the efficiency of the proposed approach. In addition, a flexible multibody system is investigated in a combined optimal control and design optimization problem. The combined optimization provides the best possible mechanical structure regarding an optimal control problem within one optimization.

mechanics
An adjoint control method for initial condition identification of the Abstract Cauchy problem

Cary Humber,Kazufumi Ito

DOI: https://doi.org/10.48550/arXiv.1202.5263

2012-02-24

Abstract:This paper develops and analyzes a generic method for reconstructing solutions to the abstract Cauchy problem in a general Hilbert space, from noisy measured data. The method is based on the relationship between a partial differential equation and its adjoint equation with control. We demonsrate the capability of the method through analysis and numerical experiments.

Optimization and Control,Analysis of PDEs,Numerical Analysis
Data-Driven Discovery of PDEs via the Adjoint Method

Mohsen Sadr,Tony Tohme,Kamal Youcef-Toumi

2024-09-30

Abstract:In this work, we present an adjoint-based method for discovering the underlying governing partial differential equations (PDEs) given data. The idea is to consider a parameterized PDE in a general form and formulate a PDE-constrained optimization problem aimed at minimizing the error of the PDE solution from data. Using variational calculus, we obtain an evolution equation for the Lagrange multipliers (adjoint equations) allowing us to compute the gradient of the objective function with respect to the parameters of PDEs given data in a straightforward manner. In particular, we consider a family of parameterized PDEs encompassing linear, nonlinear, and spatial derivative candidate terms, and elegantly derive the corresponding adjoint equations. We show the efficacy of the proposed approach in identifying the form of the PDE up to machine accuracy, enabling the accurate discovery of PDEs from data. We also compare its performance with the famous PDE Functional Identification of Nonlinear Dynamics method known as PDE-FIND (Rudy et al., 2017), on both smooth and noisy data sets. Even though the proposed adjoint method relies on forward/backward solvers, it outperforms PDE-FIND for large data sets thanks to the analytic expressions for gradients of the cost function with respect to each PDE parameter.

Optimization and Control,Machine Learning
Shock equations and jump conditions for the 2D Adjoint Euler equations

Carlos Lozano,Jorge Ponsin

DOI: https://doi.org/10.3390/aerospace10030267

2024-02-05

Abstract:This paper considers the formulation of the adjoint problem in two dimensions when there are shocks in the flow solution. For typical cost functions, the adjoint variables are continuous at shocks, where they have to obey an internal boundary condition, but their derivatives may be discontinuous. The derivation of the adjoint shock equations is reviewed and detailed predictions for the behavior of the gradients of the adjoint variables at shocks are obtained as jump conditions for the normal adjoint gradients in terms of the tangent gradients. Several numerical computations on a very fine mesh are used to illustrate the behavior of numerical adjoint solutions at shocks.

Fluid Dynamics,Numerical Analysis
Quantitative and qualitative properties for Hamilton-Jacobi PDEs via the nonlinear adjoint method

Fabio Camilli,Alessandro Goffi,Cristian Mendico

2024-10-07

Abstract:We provide some new integral estimates for solutions to Hamilton-Jacobi equations and we discuss several consequences, ranging from $L^p$-rates of convergence for the vanishing viscosity approximation to regularizing effects for the Cauchy problem in the whole Euclidean space and Liouville-type theorems. Our approach is based on duality techniques à la Evans and a careful study of advection-diffusion equations. The optimality of the results is discussed by several examples.

Analysis of PDEs
Optimal Control of the Unsteady Navier-Stokes Equations

Zhijin Li,I. M. Navon,M. Y. Hussaini

2003-01-01

Abstract: This paper is organized as follows. After a general introduction in Section 1, a basic derivation of the general expressions for the gradient of the objective functional in terms of the adjoint models is presented in Section 2. It also includes the construction of discrete adjoint models as well as the description storage strategies. The two-dimensional Navier-Stokes equations and their discretized analogs are described in Section 3. Basic procedures for checking the correctness of the adjoint...
Adjoint-Based Enforcement of State Constraints in PDE Optimization Problems

Pritpal Matharu,Bartosz Protas

DOI: https://doi.org/10.1016/j.jcp.2024.113298

2024-08-13

Abstract:This study demonstrates how the adjoint-based framework traditionally used to compute gradients in PDE optimization problems can be extended to handle general constraints on the state variables. This is accomplished by constructing a projection of the gradient of the objective functional onto a subspace tangent to the manifold defined by the constraint. This projection is realized by solving an adjoint problem defined in terms of the same adjoint operator as used in the system employed to determine the gradient, but with a different forcing. We focus on the "optimize-then-discretize" paradigm in the infinite-dimensional setting where the required regularity of both the gradient and of the projection is ensured. The proposed approach is illustrated with two examples: a simple test problem describing optimization of heat transfer in one direction and a more involved problem where an optimal closure is found for a turbulent flow described by the Navier-Stokes system in two dimensions, both considered subject to different state constraints. The accuracy of the gradients and projections computed by solving suitable adjoint systems is carefully verified and the presented computational results show that the solutions of the optimization problems obtained with the proposed approach satisfy the state constraints with a good accuracy, although not exactly.

Optimization and Control,Fluid Dynamics
Adjoint-based estimation of sensitivity of clinical measures to boundary conditions for arteries

Rainald Löhner,Harbir Antil,Fernando Mut,Juan Cebral

DOI: https://doi.org/10.1016/j.jcp.2023.112619

IF: 4.645

2024-01-01

Journal of Computational Physics

Abstract:The use of adjoint solvers is considered in order to obtain the sensitivity of clinical measures in aneurysms to incomplete (or unknown) boundary conditions and/or geometry. It is shown that these techniques offer interesting theoretical insights and viable computational tools to obtain these sensitivities. A optimization framework with Navier-Stokes equations (in the laminar regime) as constraints is introduced. Sensitivities with respect to inflow and inflow position are derived. In the specific case of inflow normal to the boundary, the sensitivities are shown to be the function of adjoint pressure. For the Poiseuille flow through a channel, explicit expressions for all the underlying quantities such as solution to the state equations, adjoint equations and sensitivites are derived, which are further confirmed by numerical experiments. In the next two examples, flow inside aneurysm geometries is considered.

physics, mathematical,computer science, interdisciplinary applications
Adjoint-Based Design Optimization of Stability Constrained Systems

Sicheng He,Eirikur Jonsson,Jichao Li,Joaquim R. R. A. Martins

DOI: https://doi.org/10.2514/1.j064273

IF: 2.624

2024-11-01

AIAA Journal

Abstract:A partial differential equation (PDE) constrained design optimization problem usually optimizes a characteristic of a dynamical system around an equilibrium point. However, a commonly omitted constraint is the linear stability constraint at the equilibrium point, which undermines the optimized solution’s applicability. To enforce the linear stability constraint in practical gradient-based optimization, the derivatives must be computed accurately, and their computational cost must scale favorably with the number of design variables. In this paper, we propose an algorithm based on the coupled adjoint method and the algorithmic differentiation method that can compute the derivative of such constraint accurately and efficiently. We verify the proposed method using several simple low-dimensional dynamical systems. The relative difference between the adjoint method and the finite differences is between [Formula: see text] to [Formula: see text]. The proposed method is demonstrated through several optimizations, including a nonlinear aeroelastic optimization. The proposed algorithm has the potential to be applied to more complex problems involving large-scale nonlinear PDEs, such as aircraft flutter and buffet suppression.

engineering, aerospace
Adjoint sensitivity in PDE constrained least squares problems as a multiphysics problem

Domenico Lahaye,Wouter Mulckhuyse

DOI: https://doi.org/10.1108/03321641211209780

2012-05-04

COMPEL The International Journal for Computation and Mathematics in Electrical and Electronic Engineering

Abstract:Purpose The purpose of this paper is to provide a framework for the implementation of an adjoint sensitivity formulation for least‐squares partial differential equations constrained optimization problems exploiting a multiphysics finite elements package. The estimation of the diffusion coefficient in a Poisson‐type diffusion equation is used as an example. Design/methodology/approach The authors derive the adjoint formulation in a continuous setting allowing to attribute to the direct and adjoint states the role of different fields to be solved for. They are one‐way coupled through the mismatch between measured and direct states acting as a source term in the adjoint equation. Having solved for the direct and adjoint state, the sensitivity of the cost function with respect to the design variables can then be obtained by a suitable post‐processing procedure. This sensitivity can then be used to efficiently solve the least‐squares problem. Findings The authors derived the adjoint formulation in a continuous setting allowing the direct and adjoint states to be attributed the role of different fields to be solved. They are one‐way coupled through the mismatch between measured and direct states acting as a source term in the adjoint equation. It is found that, having solved for the direct and adjoint state, the sensitivity of the cost function with respect to the design variables can then be obtained by a suitable post‐processing procedure. Research limitations/implications This paper implies that modern multiphysics finite elements packages provide a flexible and extendable software environment for the experimentation with different adjoint formulations. Such tools are therefore expected to become increasingly important in solving notoriously difficult partial differential equation (PDE)‐constrained least‐squares problems. The framework also provides the possibility of experimentation with different regularization techniques (total variation and multiscale techniques for instance) to handle the ill‐posedness of the problem. Originality/value In this paper the adjoint sensitivity computation is casted as a multiphysics problem allowing for a flexible and extendable implementation.
Adjoint-based Determination of Weaknesses in Structures

Facundo N. Airaudo,Rainald Löhner,Roland Wüchner,Harbir Antil

2023-03-27

Abstract:An adjoint-based procedure to determine weaknesses, or, more generally the material properties of structures is developed and tested. Given a series of force and deformation/strain measurements, the material properties are obtained by minimizing the weighted differences between the measured and computed values. Several examples with truss, plain strain and volume elements show the viability, accuracy and efficiency of the proposed methodology using both displacement and strain measurements. An important finding was that in order to obtain reliable, convergent results the gradient of the cost function has to be smoothed.

Optimization and Control,Numerical Analysis
Study on Adjoint-Based Optimization Method for Multi-Stage Turbomachinery

Weiwei Li,Yong Tian,Weilin Yi,Lucheng Ji,Weiwei Shao,Yunhan Xiao

DOI: https://doi.org/10.1007/s11630-011-0487-0

2011-01-01

Abstract:Adjoint-based optimization method is a hotspot in turbomachinery. First, this paper presents principles of adjoint method from Lagrange multiplier viewpoint. Second, combining a continuous route with thin layer RANS equations, we formulate adjoint equations and anti-physical boundary conditions. Due to the multi-stage environment in turbomachinery, an adjoint interrow mixing method is introduced. Numerical techniques of solving flow equations and adjoint equations are almost the same, and once they are converged respectively, the gradients of an objective function to design variables can be calculated using complex method efficiently. Third, integrating a shape perturbation parameterization and a simple steepest descent method, a frame of adjoint-based aerodynamic shape optimization for multi-stage turbomachinery is constructed. At last, an inverse design of an annular cascade is employed to validate the above approach, and adjoint field of an Aachen 1.5 stage turbine demonstrates the conservation and areflexia of the adjoint interrow mixing method. Then a direct redesign of a 1+1 counter-rotating turbine aiming to increase efficiency and apply constraints to mass flow rate and pressure ratio is taken.
Some Inequalities for Adjointable Operators on Hilbert -Modules

Mohammad Sababheh,Hamid Reza Moradi,Qingxiang Xu,Shuo Zhao

DOI: https://doi.org/10.1007/s11785-024-01599-x

2024-10-10

Complex Analysis and Operator Theory

Abstract:The main purpose of this paper is, in the general setting of the adjointable operators on Hilbert -modules, to develop two new tools that can be applied to deal with the positive solutions of certain operator equations, the operator norm and related quantities. Among other things, the positivity of a operator matrix is clarified without any preconditions on its entries, and a generalized version of the mixed Schwarz inequality with a parameter is derived. Numerical examples are provided to illustrate the non-triviality of this newly obtained inequality.

mathematics, applied
Essential Self-Adjointness and the L^2-Liouville Property

Hua Bobo,Masamune Jun,York College of the City University of New York

DOI: https://doi.org/10.1007/s00041-021-09833-2

2021-01-01

Journal of Fourier Analysis and Applications

Abstract:We discuss connections between the essential self-adjointness of a symmetric operator and the constancy of functions which are in the kernel of the adjoint of the operator. We then illustrate this relationship in the case of Laplacians on both manifolds and graphs. Furthermore, we discuss the Green's function and when it gives a non-constant harmonic function which is square integrable.

An Introduction to Adjoint Problems

An Automatic Adjoint Theorem and Its Applications

Geometric Methods for Adjoint Systems

Three-Dimensional Aerodynamic Design Optimization of A Turbine Blade by Using an Adjoint Method

Aerodynamic Design Optimization by Using a Continuous Adjoint Method

Partially adjoint discretizations of adjoint operators and nonconforming finite element exterior calculus

An Adjoint Method for a High-Order Discretization of Deforming Domain Conservation Laws for Optimization of Flow Problems

A discrete adjoint gradient approach for equality and inequality constraints in dynamics

An adjoint control method for initial condition identification of the Abstract Cauchy problem

Data-Driven Discovery of PDEs via the Adjoint Method

Shock equations and jump conditions for the 2D Adjoint Euler equations

Quantitative and qualitative properties for Hamilton-Jacobi PDEs via the nonlinear adjoint method

Optimal Control of the Unsteady Navier-Stokes Equations

Adjoint-Based Enforcement of State Constraints in PDE Optimization Problems

Adjoint-based estimation of sensitivity of clinical measures to boundary conditions for arteries

Adjoint-Based Design Optimization of Stability Constrained Systems

Adjoint sensitivity in PDE constrained least squares problems as a multiphysics problem

Adjoint-based Determination of Weaknesses in Structures

Study on Adjoint-Based Optimization Method for Multi-Stage Turbomachinery

Some Inequalities for Adjointable Operators on Hilbert -Modules

Essential Self-Adjointness and the L^2-Liouville Property