Abstract:A new procedure for designing optimal bounded control of quasi-nonintegrable Hamiltonian systems with actuator saturation is proposed based on the stochastic averaging method for quasi-nonintegrable Hamiltonian systems and the stochastic maximum principle. First, the stochastic averaging method for controlled quasi-nonintegrable Hamiltonian systems is introduced. The original control problem is converted into one for a partially averaged equation of system energy together with a partially averaged performance index. Then, the adjoint equation and the maximum condition of the partially averaged control problem are derived based on the stochastic maximum principle. The bounded optimal control forces are obtained from the maximum condition and solving the forward–backward stochastic differential equations (FBSDE). For infinite time-interval ergodic control, the adjoint variable is stationary process, and the FBSDE is reduced to an ordinary differential equation. Finally, the stationary probability density of the Hamiltonian and other response statistics of optimally controlled system are obtained by solving the Fokker–Plank–Kolmogorov equation associated with the fully averaged Itô equation of the controlled system. For comparison, the bang–bang control is also presented. An example of two degree-of-freedom quasi-nonintegrable Hamiltonian system is worked out to illustrate the proposed procedure and its effectiveness. Numerical results show that the proposed control strategy has higher control efficiency and less discontinuous control force than the corresponding bang–bang control at the price of slightly less control effectiveness.

A current value Hamiltonian Approach for Discrete time Optimal Control Problems arising in Economic Growth

Nonlinear Stochastic Dynamics and Control in Hamiltonian Formulation

Stochastic Optimal Control of Quasi Non-Integrable Hamiltonian Systems with Stochastic Maximum Principle

Optimal bounded control of quasi-nonintegrable Hamiltonian systems using stochastic maximum principle

ADVANCES IN RESEARCH ON NONLINEAR STOCHASTIC OPTIMAL CONTROL OF QUASI-HAMILTONIAN SYSTEMS

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Optimal Control of Discrete-Time Nonlinear Systems

Receding Hamiltonian-Informed Optimal Neural Control and State Estimation for Closed-Loop Dynamical Systems

Optimal control under nonconvexity: A generalized Hamiltonian approach

A nonlinear stochastic optimal bounded control using stochastic maximum principle

Port-Hamiltonian structures in infinite-dimensional optimal control: Primal-Dual gradient method and control-by-interconnection

Hamilton-Jacobi equations for optimal control on networks with entry or exit costs

Application of Hamilton–Jacobi–Bellman Equation/Pontryagin's Principle for Constrained Optimal Control

Improved Symplectic Method for Solving Optimal Control Problems

Optimal control of port-Hamiltonian systems: energy, entropy, and exergy

Existence of solutions to port-Hamiltonian systems: initial value problems and optimal control

Hamiltonian-Based Algorithm for Optimal Control

Hidden regularity in singular optimal control of port-Hamiltonian systems

The Hamiltonian approach to the problem of derivation of production functions in economic growth theory

Linear-quadratic optimal control for infinite-dimensional input-state-output systems

Hamiltonian realization of power system dynamic models and its applications