Abstract:Persistent dwell-time switched systems (PDTSSs) are being increasingly employed for modeling the dynamics of systems with non-uniform time-dependent switching rules. The existing attempts to design control methods for PDTSSs necessitate a prior knowledge of system dynamics. In this article, we propose a data-driven reinforcement learning (RL) method to solve the weighted $\mathcal{H}_{\infty }$ control problem for PDTSSs with completely unknown system dynamics. The proposed method aims to calculate the weighted $\mathcal{H}_{\infty }$ control gain for PDTSSs with optimal disturbance attenuation guaranteed by solving a set of linear matrix inequalities related to system data, as opposed to solving it with the exact model information. To ensure the stability of the overall switched system, we establish the criterion for exponential mean-square stability of the closed-loop PDTSSs, as well as analyze the convergence of the proposed data-driven RL algorithm. Finally, the efficacy of the designed algorithms is illustrated via an electric circuit model. Note to Practitioners —First, at a practical level, we consider a more general PDT switching rule that can effectively model the phenomenon of simultaneous fast and slow switching in real systems, which finds wide application in various engineering domains, including capacitor monolithic filters, robot manipulators, and power grids. Then, we aim to address the challenges associated with acquiring accurate system model information and ensuring stable operation with optimal disturbance attenuation performance. On the one hand, the existing $ \mathcal{H}_{\infty }$ control methods of PDTSSs only guarantee system stability with a prescribed level of disturbance attenuation, and achieving mean-square stability while maintaining an optimal level of disturbance attenuation remains a challenge. On the other hand, existing $\mathcal{H} _{\infty }$ control methods incorporate precise system dynamics that are difficult or costly to acquire in practical systems. To tackle the aforementioned challenges, we propose a data-driven weighted $\mathcal{H} _{\infty }$ control approach for PDTSSs with unknown system dynamics. This method ensures that the closed-loop PDTSSs exhibit exponential mean-square stability while achieving an optimal disturbance attenuation level. Furthermore, by leveraging RL algorithms, our controller design process only relies on system data rather than precise system dynamics.

Data-based Suboptimal Neuro-control Design with Reinforcement Learning for Dissipative Spatially Distributed Processes

Data-Driven Weighted $\mathcal{h}_{\infty }$ Control of Persistent Dwell Time Switched Systems with Optimal Disturbance Attenuation Guaranteed

Adaptive Optimal Control of Highly Dissipative Nonlinear Spatially Distributed Processes with Neuro-Dynamic Programming

Data-Driven Suboptimal Control for Nonlinear Systems Using State-Dependent Riccati Equation.

Data-Driven Control for Nonlinear Distributed Parameter Systems

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Approximate Optimal Control Design for Nonlinear One-Dimensional Parabolic PDE Systems Using Empirical Eigenfunctions and Neural Network

Suboptimal Reduced Control of Unknown Nonlinear Singularly Perturbed Systems Via Reinforcement Learning

Adaptive neural boundary control design for a class of nonlinear spatially distributed systems

Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order models

Reinforcement Learning Based Distributed Control of Dissipative Networked Systems

Adaptive Optimal Consensus Control of Multiagent Systems with Unknown Dynamics and Disturbances Via Reinforcement Learning

Interpretable and Efficient Data-driven Discovery and Control of Distributed Systems

Optimal PID and Antiwindup Control Design as a Reinforcement Learning Problem

Online Policy Iteration Algorithm for Optimal Control of Linear Hyperbolic PDE Systems

Data-Driven Near-Optimal Control of Nonlinear Systems Over Finite Horizon

Data-Based Self-Learning Optimal Control For Continuous-Time Unknown Nonlinear Systems With Disturbance

Model Predictive Control Design for Spatially-Distributed System based on Input-Output Data Sets

Online Optimization of Dynamical Systems with Deep Learning Perception

Learning-based Optimal Boundary Control for Parabolic Distributed Parameter System with Actuator Dynamics