Abstract:Persistent dwell-time switched systems (PDTSSs) are being increasingly employed for modeling the dynamics of systems with non-uniform time-dependent switching rules. The existing attempts to design control methods for PDTSSs necessitate a prior knowledge of system dynamics. In this article, we propose a data-driven reinforcement learning (RL) method to solve the weighted $\mathcal{H}_{\infty }$ control problem for PDTSSs with completely unknown system dynamics. The proposed method aims to calculate the weighted $\mathcal{H}_{\infty }$ control gain for PDTSSs with optimal disturbance attenuation guaranteed by solving a set of linear matrix inequalities related to system data, as opposed to solving it with the exact model information. To ensure the stability of the overall switched system, we establish the criterion for exponential mean-square stability of the closed-loop PDTSSs, as well as analyze the convergence of the proposed data-driven RL algorithm. Finally, the efficacy of the designed algorithms is illustrated via an electric circuit model. Note to Practitioners —First, at a practical level, we consider a more general PDT switching rule that can effectively model the phenomenon of simultaneous fast and slow switching in real systems, which finds wide application in various engineering domains, including capacitor monolithic filters, robot manipulators, and power grids. Then, we aim to address the challenges associated with acquiring accurate system model information and ensuring stable operation with optimal disturbance attenuation performance. On the one hand, the existing $ \mathcal{H}_{\infty }$ control methods of PDTSSs only guarantee system stability with a prescribed level of disturbance attenuation, and achieving mean-square stability while maintaining an optimal level of disturbance attenuation remains a challenge. On the other hand, existing $\mathcal{H} _{\infty }$ control methods incorporate precise system dynamics that are difficult or costly to acquire in practical systems. To tackle the aforementioned challenges, we propose a data-driven weighted $\mathcal{H} _{\infty }$ control approach for PDTSSs with unknown system dynamics. This method ensures that the closed-loop PDTSSs exhibit exponential mean-square stability while achieving an optimal disturbance attenuation level. Furthermore, by leveraging RL algorithms, our controller design process only relies on system data rather than precise system dynamics.

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Data-Driven Weighted $\mathcal{h}_{\infty }$ Control of Persistent Dwell Time Switched Systems with Optimal Disturbance Attenuation Guaranteed

$\mathcal H_{\infty }$ Control for 2-D Markov Jump Systems in Roesser Model

&Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\mathcal H_{\infty }$&Lt;/tex-Math> &Lt;/inline-Formula> Control for 2-D Markov Jump Systems in Roesser Model

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Model-Free $h_{2}/h_{\infty}$ Control of Discrete-Time Stochastic Systems: A Reinforcement Learning Method

Asynchronous Control of Two-Dimensional Markov Jump Roesser Systems: an Event-Triggering Strategy

Model-free Reinforcement Learning for H_2/H_∞ Control of Stochastic Discrete-time Systems

Reinforcement Learning Control of Double-Layer Markov Jump Systems with PDT-Switched Transition Probabilities

Optimal control for continuous-time Markov jump singularly perturbed systems : A hybrid reinforcement learning scheme

Fuzzy-Based Adaptive Optimization of Unknown Discrete-Time Nonlinear Markov Jump Systems With Off-Policy Reinforcement Learning

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach

Data-Driven Solutions to Mixed $h_{2}/h_{\infty}$ Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach.

Reinforcement Learning and Adaptive Optimization of a Class of Markov Jump Systems with Completely Unknown Dynamic Information

A Fuzzy-Model-Based Approach to Optimal Control for Nonlinear Markov Jump Singularly Perturbed Systems: A Novel Integral Reinforcement Learning Scheme

Off-policy reinforcement learning for tracking control of discrete-time Markov jump linear systems with completely unknown dynamics.

Parallel Optimal Tracking Control Schemes for Mode-Dependent Control of Coupled Markov Jump Systems Via Integral RL Method

Off-Policy Reinforcement Learning for $ H_\infty $ Control Design

Stabilization and H∞ Control of Two-Dimensional Markovian Jump Systems

Nonfragile Output Feedback Tracking Control for Markov Jump Fuzzy Systems Based on Integral Reinforcement Learning Scheme

H ∞ Control for Discrete-Time Nonlinear Markov Jump Systems with Multiplicative Noise and Sector Constraint