Abstract:A new procedure for designing optimal bounded control of quasi-nonintegrable Hamiltonian systems with actuator saturation is proposed based on the stochastic averaging method for quasi-nonintegrable Hamiltonian systems and the stochastic maximum principle. First, the stochastic averaging method for controlled quasi-nonintegrable Hamiltonian systems is introduced. The original control problem is converted into one for a partially averaged equation of system energy together with a partially averaged performance index. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The bounded optimal control forces are obtained from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is stationary process, and the FBSDE is reduced to an ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained by solving the Fokker–Plank–Kolmogorov equation associated with the fully averaged Itô equation of the controlled system. For comparison, the bang–bang control is also presented. An example of two degree-of-freedom quasi-nonintegrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness. Numerical results show that the proposed control strategy has higher control efficiency and less discontinuous control force than the corresponding bang–bang control at the price of slightly less control effectiveness.

Stochastic Linear Quadratic Optimal Control with General Control Domain

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Optimal bounded control of quasi-nonintegrable Hamiltonian systems using stochastic maximum principle

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Stochastic Maximum Principle for Square-Integrable Optimal Control of Linear Stochastic Systems

A nonlinear stochastic optimal bounded control using stochastic maximum principle

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Optimal Control of Constrained Stochastic Linear-Quadratic Model with Applications

ADVANCES IN RESEARCH ON NONLINEAR STOCHASTIC OPTIMAL CONTROL OF QUASI-HAMILTONIAN SYSTEMS

Stabilizing control of robustness for systems with maximum uncertain parameters - A quadratic programming approach

Mean-field stochastic linear quadratic control problem with random coefficients

Maximum principle for stochastic optimal control problem under convex expectation

Stochastic Linear-quadratic Control Problems with Affine Constraints

Optimal Feedback Controls of Stochastic Linear Quadratic Control Problems in Infinite Dimensions with Random Coefficients

A Class of Discrete-time Mean-field Stochastic Linear-quadratic Optimal Control Problems with Financial Application

Maximum principle for discrete-time stochastic optimal control problem under distribution uncertainty

Characterization of Optimal Feedback for Stochastic Linear Quadratic Control Problems

A Minimax Optimal Control Strategy for Partially Observable Uncertain Quasi-Hamiltonian Systems

Stochastic Optimal Linear Quadratic Regulation Control of Discrete-time Systems with Delay and Quadratic Constraints

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

Discrete Time Mean-Field Stochastic Linear-Quadratic Optimal Control Problems