Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.

Pointwise Second-order Necessary Conditions for Stochastic Optimal Controls, Part I: the Case of Convex Control Constraint

Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Robust pointwise second order necessary conditions for singular stochastic optimal control with model uncertainty

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Second-order sufficient conditions in optimal control of evolution systems

Second-Order Necessary/Sufficient Conditions for Optimal Control Problems in the Absence of Linear Structure

A Second-Order Maximum Principle for Singular Optimal Stochastic Controls

SECOND-ORDER NECESSARY CONDITIONS FOR OPTIMAL CONTROL OF SEMILINEAR ELLIPTIC EQUATIONS WITH LEADING TERM CONTAINING CONTROLS

General Necessary Conditions for Partially Observed Optimal Stochastic Controls

Second-Order Necessary Conditions for Optimal Control with Recursive Utilities

Second-order necessary condition for partially observed stochastic system with random jumps

Necessary and Sufficient Conditions for Optimal Control of Semilinear Stochastic Partial Differential Equations

Properties for transposition solutions to operator-valued BSEEs, and applications to robust second order necessary conditions for controlled SEEs

Stochastic Linear-quadratic Control Problems with Affine Constraints

Second-order Optimality Conditions for Time-Optimal Control Problems Governed by Semilinear Parabolic Equations

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Stochastic linear–quadratic control problems with affine constraints

The necessary and sufficient conditions for stochastic differential systems with multi-time states cost functional

Stochastic maximum principle for optimal control problem with varying terminal time and non-convex control domain

Controllability and necessary second-order optimality conditions in optimal control problems

Stochastic Singular Linear Systems and Related Linear-Quadratic Optimal Control Problems under Finite and Infinite Horizons