Abstract:In this article, a novel continuous-time optimal tracking controller is proposed for the single-input-single-output linear system with completely unknown dynamics. Unlike those existing solutions to the optimal tracking control problem, the proposed controller introduces an integral compensation to reduce the steady-state error and regulates the feedforward part simultaneously with the feedback part. An augmented system composed of the integral compensation, error dynamics, and desired trajectory is established to formulate the optimal tracking control problem. The input energy and tracking error of the optimal controller are minimized according to the objective function in the infinite horizon. With the application of reinforcement learning techniques, the proposed controller does not require any prior knowledge of the system drift or input dynamics. The integral reinforcement learning method is employed to approximate the Q-function and update the critic network on-line. And the actor network is updated with the deterministic learning method. The Lyapunov stability is proved under the persistence of excitation condition. A case study on a hydraulic loading system has shown the effectiveness of the proposed controller by simulation and experiment.

H∞ Tracking Control for Linear Discrete‐time Systems Via Reinforcement Learning

Reinforcement Learning for Finite-Horizon H∞ Tracking Control of Unknown Discrete Linear Time-Varying System

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

H∞ Tracking Control for Linear Discrete-Time Systems: Model-Free Q-Learning Designs

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

H∞ Control of Discrete Switched Systems with Time Delay Via State Feedback

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Output-feedback Q-learning for discrete-time linear H-infinity tracking control: A Stackelberg game approach

Output‐feedback Q‐learning for discrete‐time linear <i>H</i><sup>∞</sup> tracking control: A Stackelberg game approach

Finite-horizon <i>H</i><sub> </sub>tracking control for discrete-time linear systems

${\Rm H}_{\infty}$ Output Tracking Control of Discrete-Time Nonlinear Systems Via Standard Neural Network Models

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Finite-time L2−l∞ Tracking Control for Markov Jump Repeated Scalar Nonlinear Systems with Partly Usable Model Information

Output Feedback Adaptive Dynamic Programming for Linear H∞ Tracking Control

Specified convergence rate guaranteed output tracking of discrete-time systems via reinforcement learning

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

H∞ optimal output tracking control for Markov jump systems: A reinforcement learning‐based approach

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

Robust policy iteration for continuous-time stochastic $H_\infty$ control problem with unknown dynamics

Reinforcement Learning for a Discrete-Time Linear-Quadratic Control Problem with an Application