Abstract:Optimal control for improving the stability and reliability of nonlinear stochastic dynamical systems is of great significance for enhancing system performances. However, it has not been adequately investigated because the evaluation indicators for stability (e.g. maximal Lyapunov exponent) and for reliability (e.g. mean first-passage time) cannot be explicitly expressed as the functions of system states. Here, a unified procedure is established to derive optimal control strategies for improving system stability and reliability, in which a physical intuition-inspired separation technique is adopted to split feedback control forces into conservative components and dissipative components, the stochastic averaging is then utilized to express the evaluation indicators of performances of controlled system, the optimal control strategies are finally derived by minimizing the performance indexes constituted by the sigmoid function of maximal Lyapunov exponent (for stability-based control)/the reciprocal of mean first-passage time (for reliability-based control), and the mean value of quadratic form of control force. The unified procedure converts the original functional extreme problem of optimal control into an extremum value problem of multivariable function which can be solved by optimization algorithms. A numerical example is worked out to illustrate the efficacy of the optimal control strategies for enhancing system performance.

Stability Analysis of Optimal Adaptive Control Under Value Iteration Using a Stabilizing Initial Policy

Stability Analysis of Optimal Adaptive Control using Value Iteration with Approximation Errors

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Stability Analysis of Model-Free Control under Iterative Q-learning Algorithms

Revisiting approximate dynamic programming and its convergence

Learning-based adaptive optimal control of linear time-delay systems: A value iteration approach

Adaptive Iteration Learning Control with Iteration‐varying Event‐triggered Mechanism for Discrete‐time Nonlinear Systems with Random Initial States

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Robust Adaptive Iterative Learning Control for Discrete-Time Nonlinear Systems With Time-Iteration-Varying Parameters.

Optimal iterative learning control with uncertain initializations and disturbances

A policy iteration algorithm for non-Markovian control problems

Algorithms for optimization and stabilization of controlled Markov chains

Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems

Adaptive Iterative Learning Control Mechanism for Nonlinear Systems Subject to High-Order Internal Model

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Discrete-time Nonlinear Systems with Time-iteration-varying Parameter

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Discrete-time adaptive iterative learning control with unknown control directions

Homotopic policy iteration-based learning design for unknown linear continuous-time systems

Off‐policy reinforcement learning algorithm for robust optimal control of uncertain nonlinear systems

Theoretical and Numerical Analysis of Approximate Dynamic Programming with Approximation Errors