Abstract:A new procedure for designing optimal bounded control of quasi-nonintegrable Hamiltonian systems with actuator saturation is proposed based on the stochastic averaging method for quasi-nonintegrable Hamiltonian systems and the stochastic maximum principle. First, the stochastic averaging method for controlled quasi-nonintegrable Hamiltonian systems is introduced. The original control problem is converted into one for a partially averaged equation of system energy together with a partially averaged performance index. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The bounded optimal control forces are obtained from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is stationary process, and the FBSDE is reduced to an ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained by solving the Fokker–Plank–Kolmogorov equation associated with the fully averaged Itô equation of the controlled system. For comparison, the bang–bang control is also presented. An example of two degree-of-freedom quasi-nonintegrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness. Numerical results show that the proposed control strategy has higher control efficiency and less discontinuous control force than the corresponding bang–bang control at the price of slightly less control effectiveness.

A Unified Theory of Maximum Principle for Continuous and Discrete Time Optimal Control Problems

On Modeling and Optimal Control of a Class of Hybrid Systems

Optimal Control Problems with Incomplete and Different Integral Time Domains in the Objective and Constraints

Maximum principle for discrete-time stochastic optimal control problem and stochastic game

Optimal bounded control of quasi-nonintegrable Hamiltonian systems using stochastic maximum principle

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Optimal Control of Discrete-Time Nonlinear Systems

Maximum principle for partially observed stochastic recursive optimal control problems involving impulse controls

Optimal Control of Unified Chaos System

Maximum principles for partially observed mean-field stochastic systems with application to financial engineering

Stochastic maximum principle for hybrid optimal control problems under partial observation

Relationships Between the Maximum Principle and Dynamic Programming for Infinite Dimensional Stochastic Control Systems

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Maximum principle for discrete-time stochastic optimal control problem under distribution uncertainty

Maximum principle for optimal control of interacting particle system: stochastic flow model

Infinite-dimensional multiobjective optimal control in continuous time

Time Optimal Control with A Class of Dependent Input Constraints

Stochastic maximum principle for optimal control problem with varying terminal time and non-convex control domain

A General Maximum Principle for Discrete Fractional Stochastic Control System of Mean‐Field Type

A Weak Maximum Principle for Discrete Optimal Control Problems with Mixed Constraints

Time Optimal Control Problems for Some Non-Smooth Systems