Abstract:The stability and convergence analysis of a multivariable stochastic self-tuning system (STC) is very difficult because of its highly nonlinear structure. In this paper, based on the virtual equivalent system method, the structural nonlinear or nonlinear dominated multivariable self-tuning system is transformed into a structural linear or linear dominated system, thus simplifying the stability and convergence analysis of multivariable STC systems. For the control process of a multivariable stochastic STC system, parameter estimation is required, and there may be three cases of parameter estimation convergence, convergence to the actual value and divergence. For these three cases, this paper provides four theorems and two corollaries. Given the theorems and corollaries, it can be directly concluded that the convergence of parameter estimation is a sufficient condition for the stability and convergence of stochastic STC systems but not a necessary condition, and the four theorems and two corollaries proposed in this paper are independent of specific controller design strategies and specific parameter estimation algorithms. The virtual equivalent system theory proposed in this paper does not need specific control strategies, parameters and estimation algorithms but only needs the nature of the system itself, which can judge the stability and convergence of the self-tuning system and relax the dependence of the system stability convergence criterion on the system structure information. The virtual equivalent system method proposed in this paper is proved to be effective when the parameter estimation may have convergence, convergence to the actual value and divergence.

Stability Analysis of Model-Free Control under Iterative Q-learning Algorithms

On Stability Analysis of the Multirate Multivariable Predictive Control Systems

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

State feedback stabilization of uncertain discrete linear impulsive systems

Model-Free Optimal Tracking Design With Evolving Control Strategies via Q-Learning

On the Robustness of Open-Closed-loop PI-type Iterative Learning Controller for Nonlinear Systems

Stability Analysis of Optimal Adaptive Control Under Value Iteration Using a Stabilizing Initial Policy

Model-free Value Iteration Algorithm for Continuous-time Stochastic Linear Quadratic Optimal Control Problems

Stability Analysis of Optimal Adaptive Control using Value Iteration with Approximation Errors

Stability Analysis And Control Synthesis For Uncertain Polynomial Nonlinear Systems

Analysis of current cycle error assisted iterative learning control for discrete nonlinear time-varying systems

Inverse Value Iteration and Q -Learning: Algorithms, Stability, and Robustness

Robust Adaptive Iterative Learning Control for Discrete-Time Nonlinear Systems With Time-Iteration-Varying Parameters.

A High-Order Internal Model Based Iterative Learning Control Scheme for Discrete Linear Time-Varying Systems

Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systems

Stability Analysis Using Quadratic Constraints for Systems With Neural Network Controllers

Actor-Critic Reinforcement Learning for Control With Stability Guarantee

From Nonlinear Dominant System to Linear Dominant System: Virtual Equivalent System Approach for Multiple Variable Self-Tuning Control System Analysis

A Q-Learning Algorithm for Discrete-Time Linear-Quadratic Control with Random Parameters of Unknown Distribution: Convergence and Stabilization

On the Stability of Datatic Control Systems

Reinforcement Learning Control of Constrained Dynamic Systems with Uniformly Ultimate Boundedness Stability Guarantee