Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.

Necessary Conditions for Stochastic Optimal Control Problems in Infinite Dimensions

First and Second Order Necessary Conditions for Stochastic Optimal Controls

Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Stochastic Optimal Control Problems with Control and Initial-Final States Constraints

Pointwise Second-order Necessary Conditions for Stochastic Optimal Controls, Part I: the Case of Convex Control Constraint

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Necessary Optimality Conditions for Local Minimizers of Stochastic Optimal Control Problems with State Constraints

Necessary condition for optimal control of doubly stochastic systems

Necessary Condition for Near Optimal Control of Linear Forward–backward Stochastic Differential Equations

Robust pointwise second order necessary conditions for singular stochastic optimal control with model uncertainty

Second-order sufficient conditions in optimal control of evolution systems

Some results on pointwise second-order necessary conditions for stochastic optimal controls

Optimal Control for Stochastic Delay Evolution Equations

Stochastic Verification Theorem for Infinite Dimensional Stochastic Control Systems

Infinite dimensional open-loop linear quadratic stochastic optimal control problems and related games

General Necessary Conditions for Partially Observed Optimal Stochastic Controls

Necessary and Sufficient Conditions for Optimal Control of Stochastic Systems Associated with Lévy Processes

Necessary and Sufficient Conditions for Optimal Control of Semilinear Stochastic Partial Differential Equations

Global Convergence of Successive Approximations for Non-convex Stochastic Optimal Control Problems

A Revisit to Stochastic Near-Optimal Controls: the Critical Case

A Necessary Condition for Optimal Control of Initial Coupled Forward-Backward Stochastic Differential Equations with Partial Information