Abstract:A new procedure for designing optimal bounded control of quasi-nonintegrable Hamiltonian systems with actuator saturation is proposed based on the stochastic averaging method for quasi-nonintegrable Hamiltonian systems and the stochastic maximum principle. First, the stochastic averaging method for controlled quasi-nonintegrable Hamiltonian systems is introduced. The original control problem is converted into one for a partially averaged equation of system energy together with a partially averaged performance index. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The bounded optimal control forces are obtained from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is stationary process, and the FBSDE is reduced to an ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained by solving the Fokker–Plank–Kolmogorov equation associated with the fully averaged Itô equation of the controlled system. For comparison, the bang–bang control is also presented. An example of two degree-of-freedom quasi-nonintegrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness. Numerical results show that the proposed control strategy has higher control efficiency and less discontinuous control force than the corresponding bang–bang control at the price of slightly less control effectiveness.

Stochastic Maximum Principle for Infinite Dimensional Control Systems

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Stochastic Maximum Principle for Optimal Control of SPDEs

Maximum principle for stochastic control of SDEs with measurable drifts

Optimal bounded control of quasi-nonintegrable Hamiltonian systems using stochastic maximum principle

Relationships Between the Maximum Principle and Dynamic Programming for Infinite Dimensional Stochastic Control Systems

A Second-Order Maximum Principle for Singular Optimal Stochastic Controls

Stochastic Maximum Principle for Subdiffusions and Its Applications

Stochastic maximum principle for equations with delay: going to infinite dimensions to solve the non-convex case

Maximum principle for a stochastic delayed system involving terminal state constraints

Necessary Conditions for Optimal Control of Stochastic Systems with Random Jumps

Maximum principle for stochastic optimal control problem under convex expectation

Stochastic Maximum Principle for Square-Integrable Optimal Control of Linear Stochastic Systems

Stochastic maximum principle for systems driven by local martingales with spatial parameters

Stochastic Maximum Principle for Optimal Control ofPartial Differential Equations Driven by White Noise

Stochastic maximum principle for optimal control problem with varying terminal time and non-convex control domain

Stochastic maximum principle for sub-diffusions and its applications

The Maximum Principle for Partially Observed Optimal Control of Stochastic Differential Equations

Stochastic Maximum Principle for Control System with Time-varying delay

Stochastic Maximum Principle for Generalized Mean-Field Delay Control Problem

A global maximum principle for stochastic optimal control problems with delay and applications