Abstract:A new procedure for designing optimal control of quasi non-integrable Hamiltonian systems under stochastic excitations is proposed based on the stochastic averaging method for quasi non-integrable Hamiltonian systems and the stochastic maximum principle. First, the control problem consisting of 2n-dimensional equations governing the controlled quasi non-integrable system and performance index is converted into a partially averaged one consisting of one-dimensional equation of the controlled system and performance index by using the stochastic averaging method. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The optimal control forces are determined from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is a stationary process and the FBSDE is reduced to a partial differential equation. Finally, the response statistics of optimally controlled system is predicted by solving the Fokker–Plank equation (FPE) associated with the fully averaged Itô equation of the controlled system. An example of two degree-of-freedom (DOF) quasi non-integrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness.

Stochastic Maximum Principle for Stochastic Recursive Optimal Control Problem under Volatility Ambiguity

Relationship between maximum principle and dynamic programming principle for stochastic recursive optimal control problem under volatility uncertainty

Maximum principle for discrete-time stochastic optimal control problem under distribution uncertainty

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

The Global Maximum Principle for Optimal Control of Partially Observed Stochastic Systems Driven by Fractional Brownian Motion

Maximum principle for optimal control of stochastic evolution equations with recursive utilities

Stochastic maximum principle for recursive optimal control problems with varying terminal time

Maximum principle for stochastic optimal control problem under convex expectation

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Peng's Maximum Principle for a Stochastic Control Problem Driven by a Fractional and a Standard Brownian Motion

Stochastic maximum principle for discrete time mean‐field optimal control problems

First- and Second-Order Maximum Principles for Discrete-Time Stochastic Optimal Control With Recursive Utilities (December 2021)

Maximum principle for partially observed stochastic recursive optimal control problems involving impulse controls

A stochastic maximum principle for forward-backward stochastic control systems with quadratic generators and sample-wise constraints

Finite Horizon Stochastic H2/H∞ Control for Continuous‐Time Systems Driven by G‐Brownian Motion

The Maximum Principle for Discounted Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Jumps on Infinite Horizon

Necessary Conditions for Optimal Control of Stochastic Systems with Random Jumps

Optimal control with delayed information flow of systems driven by $G$-Brownian motion

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model and Its Application to Finance