Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.

Optimal Control of Stochastic Partial Differential Equations

General Doubly Stochastic Maximum Principle and Its Applications to Optimal Control of SPDEs

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Maximum Principle for Forward-Backward Doubly Stochastic Control Systems and Applications

A maximum principle for optimal control problem of fully coupled forward-backward stochastic systems with partial information

Stochastic Optimal Control for Backward Stochastic Partial Differential Systems

Stochastic Maximum Principle for Optimal Control of SPDEs

On the existence of optimal controls for backward stochastic partial differential equations

Optimal Control for Stochastic Delay Evolution Equations

Optimal Control of Forward-Backward Stochastic Differential System of Jump Diffusion with Observation Noise: Stochastic Maximum Principle

Necessary Condition for Near Optimal Control of Linear Forward–backward Stochastic Differential Equations

A Global Stochastic Maximum Principle for Fully Coupled Forward-Backward Stochastic Systems.

Maximum Principle for Backward Doubly Stochastic Control Systems with Applications

Stochastic Linear Quadratic Optimal Control with General Control Domain

Sufficient Condition for Near-Optimal Control of General Controlled Linear Forward–backward Stochastic Differential Equations

Necessary condition for optimal control of doubly stochastic systems

Partial Information Near-Optimal Control of Forward-Backward Stochastic Differential System with Observation Noise

Optimal Control of Markov Regime-Switching Stochastic Recursive Utilities

Maximum Principle for Partially Observed Optimal Control of Backward Doubly Stochastic Systems

Stochastic Maximum Principle for Subdiffusions and Its Applications

The Maximum Principles for Stochastic Recursive Optimal Control Problems under Partial Information