Abstract:Persistent dwell-time switched systems (PDTSSs) are being increasingly employed for modeling the dynamics of systems with non-uniform time-dependent switching rules. The existing attempts to design control methods for PDTSSs necessitate a prior knowledge of system dynamics. In this article, we propose a data-driven reinforcement learning (RL) method to solve the weighted $\mathcal{H}_{\infty }$ control problem for PDTSSs with completely unknown system dynamics. The proposed method aims to calculate the weighted $\mathcal{H}_{\infty }$ control gain for PDTSSs with optimal disturbance attenuation guaranteed by solving a set of linear matrix inequalities related to system data, as opposed to solving it with the exact model information. To ensure the stability of the overall switched system, we establish the criterion for exponential mean-square stability of the closed-loop PDTSSs, as well as analyze the convergence of the proposed data-driven RL algorithm. Finally, the efficacy of the designed algorithms is illustrated via an electric circuit model. Note to Practitioners —First, at a practical level, we consider a more general PDT switching rule that can effectively model the phenomenon of simultaneous fast and slow switching in real systems, which finds wide application in various engineering domains, including capacitor monolithic filters, robot manipulators, and power grids. Then, we aim to address the challenges associated with acquiring accurate system model information and ensuring stable operation with optimal disturbance attenuation performance. On the one hand, the existing $ \mathcal{H}_{\infty }$ control methods of PDTSSs only guarantee system stability with a prescribed level of disturbance attenuation, and achieving mean-square stability while maintaining an optimal level of disturbance attenuation remains a challenge. On the other hand, existing $\mathcal{H} _{\infty }$ control methods incorporate precise system dynamics that are difficult or costly to acquire in practical systems. To tackle the aforementioned challenges, we propose a data-driven weighted $\mathcal{H} _{\infty }$ control approach for PDTSSs with unknown system dynamics. This method ensures that the closed-loop PDTSSs exhibit exponential mean-square stability while achieving an optimal disturbance attenuation level. Furthermore, by leveraging RL algorithms, our controller design process only relies on system data rather than precise system dynamics.

Data-Driven Solutions to Mixed $h_{2}/h_{\infty}$ Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach.

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Data-Driven Weighted $\mathcal{h}_{\infty }$ Control of Persistent Dwell Time Switched Systems with Optimal Disturbance Attenuation Guaranteed

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Data-Driven H-infinity Control with a Real-Time and Efficient Reinforcement Learning Algorithm: An Application to Autonomous Mobility-on-Demand Systems

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Off-Policy Reinforcement Learning for $ H_\infty $ Control Design

Reinforcement-Learning-Based Tracking Control of Waste Water Treatment Process under Realistic System Conditions and Control Performance Requirements

A genetic approach to mixed H-2/H-infinity robust control design for SMES

A genetic approach to mixed H2/H∞ robust control design for SMES

Reinforcement Learning Control of Double-Layer Markov Jump Systems with PDT-Switched Transition Probabilities

Mixed-Integer Optimal Control via Reinforcement Learning: A Case Study on Hybrid Electric Vehicle Energy Management

Mixed L-1/H-2/H-Infinity Control Design: Numerical Optimization Approaches

Mixed H2/H∞ Model Predictive Control for Systems with Energy-Bounded Disturbance

Data-Driven Near-Optimal Control of Nonlinear Systems Over Finite Horizon

Data‐based distributed consensus optimal control for nonlinear multi‐agent systems under switching topology

Mixed‐Integer Optimal Control via Reinforcement Learning: A Case Study on Hybrid Electric Vehicle Energy Management

Mixed H2/H-infinity Data-Driven Control Design for Hard Disk Drives

On Mixed H2 and H-infinite Control

Multiobjective \boldmath$\ht/\hf$ Control Design

Optimal Infinite-Horizon Mixed $\mathit{H}_2/\mathit{H}_\infty$ Control