Abstract:In this paper,a stochastic minimax optimal control strategy for uncertain quasi-Hamilionian systems is proposed based on stochastic averaging method,stochastic maximum principle and stochastic differential game theory.Firstly,the partially averaged It(o) stochastic differential equations are derived using the stochastic averaging method for quasi-Hamiltonian systems,while the system state transits from rapid variable of velocity and displacement into the slow variable of energy.Secondly,the stochastic optimal control of Hamiltonian system with a given performance index is converted into a minimax control problem based on the stochastic differential game theory.Thirdly,forward-backward stochastic differential equations of the system and the adjoint process were established according to stochasticmaximum principle.The worst disturbances are generated by minimizing the Hamiltonian function,while maximizing the minimal Hamiltonian function results in the worst-case optimal controls.The worst disturbances and the worst-case optimal controls are then substituting into the partially averaged It(o) equation in order to obtain the fully averaged It(o) equation.The responses of controlled system are predicted by solving the Fokker-Planck-Kolmogorov (FPK) equation associated with the fully averaged It(o) equation.Meanwhile,the control effectiveness can also be computed.Finally,the proposed stochastic optimal control of uncertain quasi-Hamiltonian system is applied into a two-DOF nonlinear system.The effectiveness of the minimax control strategy is validated by numerical results.

Adaptive dynamic programming and distributionally robust optimal control of linear stochastic system using the Wasserstein metric

Data-drivenDistributionallyRobustOptimal Stochastic ControlUsing theWassersteinMetric

Distributional robustness in minimax linear quadratic control with Wasserstein distance

Minimax control of ambiguous linear stochastic systems using the Wasserstein metric

Wasserstein Distributionally Robust Control of Partially Observable Linear Stochastic Systems

Distributionally Robust Infinite-horizon Control: from a pool of samples to the design of dependable controllers

Nonlinear Wasserstein Distributionally Robust Optimal Control

Distributionally robust uncertainty quantification via data-driven stochastic optimal control

Infinite-Horizon Distributionally Robust Regret-Optimal Control

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

A Distributionally Robust Approach to Regret Optimal Control using the Wasserstein Distance

Wasserstein Distributionally Robust Regret-Optimal Control in the Infinite-Horizon

Distributionally Robust Density Control with Wasserstein Ambiguity Sets

Distributionally Robust Differential Dynamic Programming with Wasserstein Distance

A Distributionally Robust Optimization based Method for Stochastic Model Predictive Control

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Robustness Of Non-Linear Stochastic Optimal Control For Quasi-Hamiltonian Systems With Parametric Uncertainty

STOCHASTIC OPTIMAL CONTROL OF UNCERTAIN QUASI-HAMILTONIAN SYSTEMS

Wasserstein Distributionally Robust Control and State Estimation for Partially Observable Linear Systems

A Minimax Optimal Control Strategy for Uncertain Quasi-Hamiltonian Systems

Distributionally robust stochastic optimal control