Abstract:Summary This article introduces a novel optimal trajectory tracking control scheme designed for uncertain linear discrete‐time (DT) systems. In contrast to traditional tracking control methods, our approach removes the requirement for the reference trajectory to align with the generator dynamics of an autonomous dynamical system. Moreover, it does not demand the complete desired trajectory to be known in advance, whether through the generator model or any other means. Instead, our approach can dynamically incorporate segments (finite horizons) of reference trajectories and autonomously learn an optimal control policy to track them in real time. To achieve this, we address the tracking problem by learning a time‐varying ‐function through state feedback. This ‐function is then utilized to calculate the optimal feedback gain and explicitly time‐varying feedforward control input, all without the need for prior knowledge of the system dynamics or having the complete reference trajectory in advance. Additionally, we introduce an adaptive observer to extend the applicability of the tracking control scheme to situations where full state measurements are unavailable. We rigorously establish the closed‐loop stability of our optimal adaptive control approach, both with and without the adaptive observer, employing Lyapunov theory. Moreover, we characterize the optimality of the controller with respect to the finite horizon length of the known components of the desired trajectory. To further enhance the controller's adaptability and effectiveness in multitask environments, we employ the Efficient Lifelong Learning Algorithm, which leverages a shared knowledge base within the recursive least squares algorithm for multitask ‐learning. The efficacy of our approach is substantiated through a comprehensive set of simulation results by using a power system example.

Data-Driven Learning Control Algorithms for Unachievable Tracking Problems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Extended Iterative Learning Control for Inconsistent Tracking Problems with Random Dropouts

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Accelerated Learning Control for Point-to-Point Tracking Systems.

Discrete-time adaptive iterative learning control with unknown control directions

Design and Analysis of Data-Driven Learning Control: an Optimization-Based Approach.

An Indirect Data-Driven Method for Trajectory Tracking Control of a Class of Nonlinear Discrete-Time Systems

Data-based Control Design for Learning Systems

Adaptive Iterative Learning Control for a Class of Nonlinear Strict-Feedback Systems with Unknown State Delays

Iterative Learning Tracking Control for Nonlinear Systems Based on Data Driven Control

Data-Driven Tracking Control for Multi-Agent Systems with Unknown Dynamics Via Multithreading Iterative Q-Learning

Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method

Model-Free H∞ Optimal Tracking Control of Constrained Nonlinear Systems Via an Iterative Adaptive Learning Algorithm

Data-driven finite-horizon optimal tracking control scheme for completely unknown discrete-time nonlinear systems.

Learning-Based Tracking Control of Unknown Robot Systems with Online Parameter Estimation

A Novel Iterative Learning Path-Tracking Control for Nonholonomic Mobile Robots Against Initial Shifts

Data-driven gradient-based point-to-point iterative learning control for nonlinear systems

Optimal trajectory tracking for uncertain linear discrete‐time systems using time‐varying Q‐learning

An Accelerated Adaptive Gain Design in Stochastic Learning Control