Abstract:In this article, by using singular perturbation theory, reinforcement learning (RL), and Takagi–Sugeno (T‐S) fuzzy methods, a RL‐fuzzy‐based composite suboptimal control method is proposed for nonlinear slow‐fast coupled systems (SFCSs) with unknown slow dynamics. First, the SFCSs is decomposed into slow and fast subsystems and the original optimal control problem is reduced to two subproblems. Then, for the slow subsystem, a nonlinear coordinate transformation is introduced to transform the nonquadratic slow utility function into the quadratic form. Unmeasurable virtual slow subsystem state is reconstructed by the state measurements of original system and slow controller design algorithm is proposed in the framework of RL by utilizing the actor‐critic neural networks to approximate the controller and cost function. For the fast subsystem, T‐S fuzzy model is established and state measurements of the original system are exploited to reconstruct the unmeasurable fast subsystem state. Fast controller is designed with the approach of parallel distributed compensation. The obtained slow and fast controllers form the composite suboptimal controller for the original SFCSs. Considering the state reconstruction error, convergence of the slow controller design algorithm, suboptimality of the composite controller, and stability of the closed‐loop SFCSs are analyzed. Finally, the effectiveness of our proposed method is illustrated by examples.

Suboptimal Reduced Control of Unknown Nonlinear Singularly Perturbed Systems Via Reinforcement Learning

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Reinforcement Learning Based Optimal Control of Linear Singularly Perturbed Systems

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Reduced-dimensional reinforcement learning control using singular perturbation approximations

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Data-Driven Suboptimal Control for Nonlinear Systems Using State-Dependent Riccati Equation.

Approximate Optimized Backstepping Control of Uncertain Fractional-Order Nonlinear Systems Based on Reinforcement Learning

Suboptimal H∞ Dynamic Output Feedback Control for Singularly Perturbed Systems

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Synchronous Optimal Control Method for Nonlinear Systems with Saturating Actuators and Unknown Dynamics Using Off-Policy Integral Reinforcement Learning

NN Reinforcement Learning Adaptive Control for a Class of Nonstrict-Feedback Discrete-Time Systems

Suboptimal Control of a Class of Nonlinear Singularly Perturbed Systems

Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems with State Constraints and Its Application.

Suboptimal control for nonlinear slow‐fast coupled systems using reinforcement learning and Takagi–Sugeno fuzzy methods

Adaptive Optimal Output Regulation of Interconnected Singularly Perturbed Systems with Application to Power Systems

Robust Safe Reinforcement Learning Control of Unknown Continuous-Time Nonlinear Systems with State Constraints and Disturbances

Optimal control for continuous-time Markov jump singularly perturbed systems : A hybrid reinforcement learning scheme

Reinforcement Learning-Based Optimal Stabilization for Unknown Nonlinear Systems Subject to Inputs With Uncertain Constraints

Hybrid Reinforcement Learning for Optimal Control of Non-Linear Switching System

Reinforcement learning‐based composite suboptimal control for Markov jump singularly perturbed systems with unknown dynamics