Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.

General Doubly Stochastic Maximum Principle and Its Applications to Optimal Control of SPDEs

Optimal Control of Stochastic Partial Differential Equations

Maximum Principle for Forward-Backward Doubly Stochastic Control Systems and Applications

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Maximum Principle for Backward Doubly Stochastic Control Systems with Applications

Stochastic Maximum Principle for Optimal Control of SPDEs

A General Maximum Principle for Optimal Control of Forward–backward Stochastic Systems

Stochastic Maximum Principle for Subdiffusions and Its Applications

A General Stochastic Maximum Principle for SDEs of Mean-field Type

Maximum principle for discrete-time stochastic optimal control problem and stochastic game

A Maximum Principle for Stochastic Optimal Control with Terminal State Constraints, and Its Applications

Maximum Principles for Backward Doubly Stochastic Systems with Jumps and Applications

Stochastic maximum principle for sub-diffusions and its applications

The Maximum Principles for Stochastic Recursive Optimal Control Problems under Partial Information

Stochastic maximum principle, dynamic programming principle, and their relationship for fully coupled forward-backward stochastic controlled systems

Maximum Principle for Partially Observed Optimal Control of Backward Doubly Stochastic Systems

Brief paper: Stochastic maximum principle in the mean-field controls

A maximum principle for optimal control problem of fully coupled forward-backward stochastic systems with partial information

A general stochastic maximum principle for optimal control problems

A Maximum Principle for a Class of Stochastic Control Problems with Partial Information

Maximum principle for stochastic optimal control problem under convex expectation