Wang Zhijun,Kazumune Hashimoto,Wataru Hashimoto,Shigemasa Takai,Wang ZhijunKazumune HashimotoWataru HashimotoShigemasa TakaiGraduate School of Engineering,Osaka University,Suita,JapanWang Zhijun received the M.E degree from Osaka University,Japan in 2023. His research interest include model predictive control,networked control systems and machine learning.Kazumune Hashimoto received the first M.E. degree from the KTH Royal Institute of Technology,Sweden,in 2014,and the second M.E. degree and the Ph.D. degree from Keio University,Japan,in 2015 and 2018,respectively. From 2018 to 2020,he was a Postdoctoral Researcher with the KTH Royal Institute of Technology,Sweden,and Osaka University,Japan. Currently,he is a lecturer at Osaka University,Japan. His research interests include model predictive control,networked control systems,and formal methods for control theory.Wataru Hashimoto received the M.E degree from Osaka University,Japan in 2021. Currently,his is a PhD student at Osaka University,Japan. His research interest include model predictive control and machine learning.Shigemasa Takai received the B.E.and M.E. degrees from Kobe University,Kobe,Japan,in 1989 and 1991,respectively,and the Ph.D. degree from Osaka University,Suita,Japan,in 1995.From 1992 to 1998,he was a Research Associate with Osaka University. In 1998,he joined Wakayama University,Wakayama,Japan,as a Lecturer,and became an Associate Professor in 1999. From 2004 to 2009,he was an Associate Professor with Kyoto Institute of Technology,Kyoto,Japan. Since 2009,he has been a Professor with Osaka University,Suita,Japan. His research interests include supervisory control and fault diagnosis of discrete event systems.

Abstract:This paper investigates the design of self-triggered control for networked control systems (NCS), where the dynamics of the plant are initially unknown. Given the nature of the self-triggered control where state measurements are sent to the controller a -periodically, our proposal involves augmenting the continuous-time dynamics to a novel dynamical model that incorporates inter-event time as a supplemental input. Then, this new model is studied through Gaussian processes (GP) regression. Additionally, we propose a learning-based approach where a self-triggered controller is formulated by minimizing a cost function for the newly learned model, ensuring consideration of inter-sample behavior. The usage of the lifting approach facilitates the application of gradient-based policy updates, allowing for the effective optimization of both control and communication policies. Finally, we provide a numerical simulation to illustrate the effectiveness of the proposed approach.

Self‐triggered control for linear systems based on hierarchical reinforcement learning

Constraint Function Based Hierarchical Control of Discrete Event Systems

Data-Driven Self-Triggered Control for Networked Motor Control Systems Using RNNs and Pre-Training: A Hierarchical Reinforcement Learning Framework

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Data-driven Self-triggered Control via Trajectory Prediction

Adaptive Event-triggered Reinforcement Learning Control for Complex Nonlinear Systems

Event-triggered Hierarchical Learning Control of Air-Breathing Hypersonic Vehicles with Predefined-Time Convergence

Multiple Model-Based Event-Triggered Adaptive Control of a Class of Discrete-Time Nonlinear Systems.

A lifting approach to learning-based self-triggered control with Gaussian processes

Self-Triggered Model Predictive Control for Perturbed Nonlinear Systems - an Iterative Implementation.

Model-Based adaptive event-Triggered control of nonlinear continuous-Time systems

Hybrid Event-Triggered Intermittent Control for Nonlinear Multi-Agent Systems

Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems

Command Filter-Based Adaptive Fuzzy Self-Triggered Control for MIMO Nonlinear Systems with Time-Varying Full-State Constraints

Hierarchical learning control for autonomous robots inspired by central nervous system

Self-Learning Optimal Control with Performance Analysis using Event-Triggered Adaptive Dynamic Programming

Reinforcement Learning-Based Predefined-Time Tracking Control for Nonlinear Systems Under Identifier-Critic-Actor Structure

Pinning-Based Neural Control for Multiagent Systems With Self-Regulation Intermediate Event-Triggered Method

A symbolic approach to the self-triggered design for networked control systems

Model-Based Safe Reinforcement Learning with Time-Varying State and Control Constraints: An Application to Intelligent Vehicles

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults