Abstract:This paper develops an optimal control scheme for continuous-time unknown nonlinear systems using the event-triggering mechanism. Different from designing controllers using the time-triggering mechanism, the event-triggered controller is updated only when the system state deviates more than a certain threshold from a prescribed value. To obtain the event-triggered optimal controller, we develop an identifier-critic architecture under the framework of reinforcement learning. The identifier network, composed of a feedforward neural network (FNN), aims to derive the knowledge of unknown system dynamics, and the critic network, constituted of an FNN, intends to derive the event-triggered optimal controller. The identifier network is tuned via the combination of a standard back-propagation algorithm and an ${e}$ -modification method, and the critic network is updated using a modification of the gradient descent method. By introducing an additional stability term to update the critic network, the initial admissible control is no longer required. Meanwhile, by using historical and instantaneous state data together, the persistence of excitation condition is relaxed. A stability analysis of the closed-loop system is provided based on the Lyapunov method. The effectiveness of the proposed designs is illustrated through simulations of a nonlinear example and a single link robot arm system.

Event-triggered Suboptimal Control Based Adaptive Reinforcement Learning.

Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems

Event-triggered Adaptive Control for a Class of Discrete-Time Uncertain Nonlinear Systems

Adaptive Iteration Learning Control with Iteration‐varying Event‐triggered Mechanism for Discrete‐time Nonlinear Systems with Random Initial States

Discrete-time optimal control scheme based on Q-learning algorithm

Online Event-Triggered Adaptive Optimal Control of Nonlinear Large-Scale Systems

Event-trigger-based Robust Control for Nonlinear Constrained-Input Systems Using Reinforcement Learning Method

Self-Learning Optimal Control with Performance Analysis using Event-Triggered Adaptive Dynamic Programming

Event-Triggered Data-Driven Control of Nonlinear Systems Via $Q$ -Learning

Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems Via Reinforcement Learning

Fuzzy Adaptive Tracking of Constrained Nonlinear Systems with Event-Sampling Reinforcement Learning

Adaptive Neural Event-Triggered Optimal Tracking Control for Discrete-Time Pure-Feedback Systems

Event-Triggered Optimal Neuro-Controller Design with Reinforcement Learning for Unknown Nonlinear Systems.

Adaptive Event-triggered Reinforcement Learning Control for Complex Nonlinear Systems

Event-triggered sub-optimal control for two-time-scale systems with unknown dynamics

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

Observer-Based Event-Triggered Optimal Control for Nonlinear Multiagent Systems with Input Delay Via Reinforcement Learning Strategy

NN Reinforcement Learning Adaptive Control for a Class of Nonstrict-Feedback Discrete-Time Systems

Fuzzy-Based Optimal Control for Stochastic Nonlinear Systems with Constrained Inputs Via Dynamic Event-Triggering

Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems with State Constraints and Its Application.

Dynamic Event-triggered Approximate Optimal Control Strategy for Nonlinear Systems