Abstract:In this paper,a stochastic minimax optimal control strategy for uncertain quasi-Hamilionian systems is proposed based on stochastic averaging method,stochastic maximum principle and stochastic differential game theory.Firstly,the partially averaged It(o) stochastic differential equations are derived using the stochastic averaging method for quasi-Hamiltonian systems,while the system state transits from rapid variable of velocity and displacement into the slow variable of energy.Secondly,the stochastic optimal control of Hamiltonian system with a given performance index is converted into a minimax control problem based on the stochastic differential game theory.Thirdly,forward-backward stochastic differential equations of the system and the adjoint process were established according to stochasticmaximum principle.The worst disturbances are generated by minimizing the Hamiltonian function,while maximizing the minimal Hamiltonian function results in the worst-case optimal controls.The worst disturbances and the worst-case optimal controls are then substituting into the partially averaged It(o) equation in order to obtain the fully averaged It(o) equation.The responses of controlled system are predicted by solving the Fokker-Planck-Kolmogorov (FPK) equation associated with the fully averaged It(o) equation.Meanwhile,the control effectiveness can also be computed.Finally,the proposed stochastic optimal control of uncertain quasi-Hamiltonian system is applied into a two-DOF nonlinear system.The effectiveness of the minimax control strategy is validated by numerical results.

OPTIMALITY STRATEGY OF AVERAGE COST BASED PERFORMANCE POTENTIALS FOR MARKOV CONTROL PROCESS

An Integrated Design for Batch Process Using Optimal Average Profit Control with Unfixed Terminal Time

Performance Optimization of Continuous-Time Markov Control Processes Based on Performance Potentials

Study on optimal control strategy for a class of piecewise linear hybrid systems

Optimal Guaranteed Cost Control of Dynamic Interval Systems: an LMI Approach

Optimization Algorithms for Semi-Markov Control Processes with Average Criteria

Optimal Stationary Policies for Semi-Markov Control Processes with Discounted-Cost Criteria

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Potential Based Optimization Algorithm Of Constrained Markov Decision Processes

Optimal Stationary Policies for a Class of Countable Markov Control Processes

Parallel Optimization for Markov Control Processes Based on Performance Potentials Simulation

Optimality equations based performance potentials for a class of controlled closed queueing networks

On the optimality equation for average cost Markov decision processes and its validity for inventory control

Optimal control of probabilistic discrete event systems on Markov decision processes

Performance Optimization for Countable Semi-Markov Decision Processes with Discounted-cost

On Average Optimality for Non-Stationary Markov Decision Processes in Borel Spaces

A Minimax Optimal Control Strategy for Uncertain Quasi-Hamiltonian Systems

STOCHASTIC OPTIMAL CONTROL OF UNCERTAIN QUASI-HAMILTONIAN SYSTEMS

Batch-to-batch Optimization for Economic Performance Improvement in Batch Processes by Rational Disturbances Utilization

AN OPTIMAL TIME-DELAY CONTROL METHOD BASED ON THE STOCHASTIC AVERAGING

Average cost optimal control under weak ergodicity hypotheses: Relative value iterations