Abstract:Persistent dwell-time switched systems (PDTSSs) are being increasingly employed for modeling the dynamics of systems with non-uniform time-dependent switching rules. The existing attempts to design control methods for PDTSSs necessitate a prior knowledge of system dynamics. In this article, we propose a data-driven reinforcement learning (RL) method to solve the weighted $\mathcal{H}_{\infty }$ control problem for PDTSSs with completely unknown system dynamics. The proposed method aims to calculate the weighted $\mathcal{H}_{\infty }$ control gain for PDTSSs with optimal disturbance attenuation guaranteed by solving a set of linear matrix inequalities related to system data, as opposed to solving it with the exact model information. To ensure the stability of the overall switched system, we establish the criterion for exponential mean-square stability of the closed-loop PDTSSs, as well as analyze the convergence of the proposed data-driven RL algorithm. Finally, the efficacy of the designed algorithms is illustrated via an electric circuit model. Note to Practitioners —First, at a practical level, we consider a more general PDT switching rule that can effectively model the phenomenon of simultaneous fast and slow switching in real systems, which finds wide application in various engineering domains, including capacitor monolithic filters, robot manipulators, and power grids. Then, we aim to address the challenges associated with acquiring accurate system model information and ensuring stable operation with optimal disturbance attenuation performance. On the one hand, the existing $ \mathcal{H}_{\infty }$ control methods of PDTSSs only guarantee system stability with a prescribed level of disturbance attenuation, and achieving mean-square stability while maintaining an optimal level of disturbance attenuation remains a challenge. On the other hand, existing $\mathcal{H} _{\infty }$ control methods incorporate precise system dynamics that are difficult or costly to acquire in practical systems. To tackle the aforementioned challenges, we propose a data-driven weighted $\mathcal{H} _{\infty }$ control approach for PDTSSs with unknown system dynamics. This method ensures that the closed-loop PDTSSs exhibit exponential mean-square stability while achieving an optimal disturbance attenuation level. Furthermore, by leveraging RL algorithms, our controller design process only relies on system data rather than precise system dynamics.

Data‐driven disturbance compensation control for discrete‐time systems based on reinforcement learning

Data-Driven Weighted $\mathcal{h}_{\infty }$ Control of Persistent Dwell Time Switched Systems with Optimal Disturbance Attenuation Guaranteed

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

Data-driven adaptive compensation control for a class of nonlinear discrete-time system with bounded disturbances

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Data-Driven H∞ Optimal Output Feedback Control for Linear Discrete-Time Systems Based on Off-Policy Q-Learning

Quadratic Tracking Control of Linear Stochastic Systems with Unknown Dynamics Using Average Off-Policy Q-Learning Method

Active learning for anti-disturbance dual control of unknown nonlinear systems

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

SODO Based Reinforcement Learning Anti-Disturbance Fault Toler-Ant Control for a Class of Nonlinear Uncertain Systems With Matched and Mismatched Disturbances

Output Feedback Control Based on State and Disturbance Estimation

Reinforcement Learning-Based Direct Adaptive Optimal Control of JLQ Model

Model-free anti-disturbance tracking control for high-order discrete-time nonlinear system based on concurrent learning extended state observer

Fuzzy-Based Adaptive Optimization of Unknown Discrete-Time Nonlinear Markov Jump Systems With Off-Policy Reinforcement Learning

Distributionally Robust Stochastic Data-Driven Predictive Control with Optimized Feedback Gain

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Online Consensus Control of Nonlinear Affine Systems From Disturbed Data

Optimal trajectory tracking for uncertain linear discrete‐time systems using time‐varying Q‐learning

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm