Abstract:Summary This article introduces a novel optimal trajectory tracking control scheme designed for uncertain linear discrete‐time (DT) systems. In contrast to traditional tracking control methods, our approach removes the requirement for the reference trajectory to align with the generator dynamics of an autonomous dynamical system. Moreover, it does not demand the complete desired trajectory to be known in advance, whether through the generator model or any other means. Instead, our approach can dynamically incorporate segments (finite horizons) of reference trajectories and autonomously learn an optimal control policy to track them in real time. To achieve this, we address the tracking problem by learning a time‐varying ‐function through state feedback. This ‐function is then utilized to calculate the optimal feedback gain and explicitly time‐varying feedforward control input, all without the need for prior knowledge of the system dynamics or having the complete reference trajectory in advance. Additionally, we introduce an adaptive observer to extend the applicability of the tracking control scheme to situations where full state measurements are unavailable. We rigorously establish the closed‐loop stability of our optimal adaptive control approach, both with and without the adaptive observer, employing Lyapunov theory. Moreover, we characterize the optimality of the controller with respect to the finite horizon length of the known components of the desired trajectory. To further enhance the controller's adaptability and effectiveness in multitask environments, we employ the Efficient Lifelong Learning Algorithm, which leverages a shared knowledge base within the recursive least squares algorithm for multitask ‐learning. The efficacy of our approach is substantiated through a comprehensive set of simulation results by using a power system example.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Continuous Robust Tracking Controllers for a Class of Uncertain Nonlinear Dynamical Systems

A Two-stage Optimal Controller for Hydraulic Loading System with Mechanical Compensation

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Realization of Exact Tracking Control for Nonlinear Systems Via a Nonrecursive Dynamic Design.

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Constrained Reinforcement Learning-Based Closed-Loop Reference Model for Optimal Tracking Control of Unknown Continuous-Time Systems

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Adaptive Optimal Tracking Control of Unknown Nonlinear Systems Using System Augmentation.

Optimal trajectory tracking for uncertain linear discrete‐time systems using time‐varying Q‐learning

Reinforcement Learning Tracking Control for Unknown Continuous Dynamic Systems

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Robust Tracking Control of Unknown Nonlinear Systems With Discontinuous References Under Output Constraints

Adaptive Tracking Control of a Class of Linear Systems with Constrained Actuators