Abstract:In this article, by using singular perturbation theory, reinforcement learning (RL), and Takagi–Sugeno (T‐S) fuzzy methods, a RL‐fuzzy‐based composite suboptimal control method is proposed for nonlinear slow‐fast coupled systems (SFCSs) with unknown slow dynamics. First, the SFCSs is decomposed into slow and fast subsystems and the original optimal control problem is reduced to two subproblems. Then, for the slow subsystem, a nonlinear coordinate transformation is introduced to transform the nonquadratic slow utility function into the quadratic form. Unmeasurable virtual slow subsystem state is reconstructed by the state measurements of original system and slow controller design algorithm is proposed in the framework of RL by utilizing the actor‐critic neural networks to approximate the controller and cost function. For the fast subsystem, T‐S fuzzy model is established and state measurements of the original system are exploited to reconstruct the unmeasurable fast subsystem state. Fast controller is designed with the approach of parallel distributed compensation. The obtained slow and fast controllers form the composite suboptimal controller for the original SFCSs. Considering the state reconstruction error, convergence of the slow controller design algorithm, suboptimality of the composite controller, and stability of the closed‐loop SFCSs are analyzed. Finally, the effectiveness of our proposed method is illustrated by examples.

Reinforcement learning‐based composite suboptimal control for Markov jump singularly perturbed systems with unknown dynamics

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Optimal control for continuous-time Markov jump singularly perturbed systems : A hybrid reinforcement learning scheme

A Fuzzy-Model-Based Approach to Optimal Control for Nonlinear Markov Jump Singularly Perturbed Systems: A Novel Integral Reinforcement Learning Scheme

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Reinforcement Learning and Adaptive Optimization of a Class of Markov Jump Systems with Completely Unknown Dynamic Information

Reinforcement Learning-Based Optimal Control for Markov Jump Systems with Completely Unknown Dynamics

Adaptive Composite Suboptimal Control for Linear Singularly Perturbed Systems with Unknown Slow Dynamics

Model-free optimal controller for discrete-time Markovian jump linear systems: A Q-learning approach

Suboptimal control for nonlinear slow‐fast coupled systems using reinforcement learning and Takagi–Sugeno fuzzy methods

Suboptimal Reduced Control of Unknown Nonlinear Singularly Perturbed Systems Via Reinforcement Learning

Stochastic LQ optimal control for Markov jumping systems with multiplicative noise using reinforcement learning

Finite-Time Control of Markov Jump Lur'e Systems with Singular Perturbations

Composite Learning Fuzzy Control of Stochastic Nonlinear Strict-Feedback Systems

Optimal tracking control for completely unknown nonlinear discrete-time Markov jump systems using data-based reinforcement learning method.

Finite-Time Composite Disturbance Rejection Control for Discrete-Time Markovian Jump Systems

A Neural Network Based Online Learning and Control Approach for Markov Jump Systems

Fuzzy-Based Adaptive Optimization of Unknown Discrete-Time Nonlinear Markov Jump Systems With Off-Policy Reinforcement Learning

Fuzzy H∞ Control of Discrete-Time Nonlinear Markov Jump Systems via a Novel Hybrid Reinforcement Q-Learning Method

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach

Fuzzy $H_{\infty }$ Control of Discrete-Time Nonlinear Markov Jump Systems via a Novel Hybrid Reinforcement $Q$-Learning Method