Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.

Optimal Control of Markov Regime-Switching Stochastic Recursive Utilities

Maximum principle for optimal control of stochastic evolution equations with recursive utilities

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

First- and Second-Order Maximum Principles for Discrete-Time Stochastic Optimal Control With Recursive Utilities (December 2021)

Maximum Principles of Markov Regime-Switching Forward-Backward Stochastic Differential Equations with Jumps and Partial Information

Stochastic linear-quadratic optimal control problems with non-Markovian regime switching

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model with Delay and an Application to Finance

A stochastic hybrid optimal control with regime switching and recursive cost functional

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model and Its Application to Finance

Stochastic linear-quadratic optimal control problems with multi-dimensional state and non-Markovian regime switching

Controllability of Stochastic Differential Equations with Markovian Switching

The Maximum Principle for Discounted Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Jumps on Infinite Horizon

Maximum principle for partially observed stochastic recursive optimal control problems involving impulse controls

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Stochastic linear quadratic optimal control problems with regime-switching jumps in infinite horizon

A stochastic maximum principle for forward-backward stochastic control systems with quadratic generators and sample-wise constraints

Risk‐sensitive stochastic maximum principle for forward‐backward systems involving impulse controls

Non-homogeneous stochastic LQ control with regime switching and random coefficients

Stochastic maximum principle for recursive optimal control problems with varying terminal time

Robust optimal stopping with regime switching