Abstract:In this article, a novel continuous-time optimal tracking controller is proposed for the single-input-single-output linear system with completely unknown dynamics. Unlike those existing solutions to the optimal tracking control problem, the proposed controller introduces an integral compensation to reduce the steady-state error and regulates the feedforward part simultaneously with the feedback part. An augmented system composed of the integral compensation, error dynamics, and desired trajectory is established to formulate the optimal tracking control problem. The input energy and tracking error of the optimal controller are minimized according to the objective function in the infinite horizon. With the application of reinforcement learning techniques, the proposed controller does not require any prior knowledge of the system drift or input dynamics. The integral reinforcement learning method is employed to approximate the Q-function and update the critic network on-line. And the actor network is updated with the deterministic learning method. The Lyapunov stability is proved under the persistence of excitation condition. A case study on a hydraulic loading system has shown the effectiveness of the proposed controller by simulation and experiment.

Model-Free Linear Discrete-Time System H∞ Control Using Input-Output Data

Adaptive Output-Feedback Control of Nonlinear Systems with Unknown Nonlinearities.

Interactions of salts and denaturing agents with a polyacrylamide gel.

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal H∞ output feedback control for a class of nonlinear systems

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Asynchronous Static Output-Feedback Control of Markovian Jump Linear Systems

${\Rm H}_{\infty}$ Output Tracking Control of Discrete-Time Nonlinear Systems Via Standard Neural Network Models

Output Feedback H∞ Controller Design for Linear Discrete-Time Systems with Sensor Nonlinearities

Asynchronous Static Output Feedback Control of Discrete-time Markov Jump Systems

A Markov Jump Model Approach to Reliable Event-Triggered Retarded Dynamic Output Feedback H∞ Control for Networked Systems

H∞ Tracking Control for Linear Discrete-Time Systems: Model-Free Q-Learning Designs

Resilient Asynchronous H∞ Control Designed for Discrete-Time Markov Jump Systems: Static Output Feedback Case

Model-based and Data-based Dynamic Output Feedback for Externally Positive Systems

Model Free Adaptive Control for a Class of Nonlinear Systems with Output Saturation

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

An efficient data-based off-policy Q-learning algorithm for optimal output feedback control of linear systems

Model-Free Control Design for Feedback-Linearizable SISO Systems

Data-driven control of nonlinear systems from input-output data