Abstract:Summary This article introduces a novel optimal trajectory tracking control scheme designed for uncertain linear discrete‐time (DT) systems. In contrast to traditional tracking control methods, our approach removes the requirement for the reference trajectory to align with the generator dynamics of an autonomous dynamical system. Moreover, it does not demand the complete desired trajectory to be known in advance, whether through the generator model or any other means. Instead, our approach can dynamically incorporate segments (finite horizons) of reference trajectories and autonomously learn an optimal control policy to track them in real time. To achieve this, we address the tracking problem by learning a time‐varying ‐function through state feedback. This ‐function is then utilized to calculate the optimal feedback gain and explicitly time‐varying feedforward control input, all without the need for prior knowledge of the system dynamics or having the complete reference trajectory in advance. Additionally, we introduce an adaptive observer to extend the applicability of the tracking control scheme to situations where full state measurements are unavailable. We rigorously establish the closed‐loop stability of our optimal adaptive control approach, both with and without the adaptive observer, employing Lyapunov theory. Moreover, we characterize the optimality of the controller with respect to the finite horizon length of the known components of the desired trajectory. To further enhance the controller's adaptability and effectiveness in multitask environments, we employ the Efficient Lifelong Learning Algorithm, which leverages a shared knowledge base within the recursive least squares algorithm for multitask ‐learning. The efficacy of our approach is substantiated through a comprehensive set of simulation results by using a power system example.

Adaptive Trajectory Tracking of Quantum Systems

On stochastic adaptive control under quantization

Adaptive backstepping control of uncertain linear systems under unknown actuator delay

Quantum Control Design by Lyapunov Trajectory Tracking and Optimal Control

Robust Trajectory Tracking Control of Underactuated Unmanned Surface Vehicles with Exponential Stability: Theory and Experimental Validation.

Trajectory Tracking Control for Robot Manipulators with Bounded Inputs Based on the Singular Perturbation Theory

Trajectory Tracking and Disturbance Rejection Control of Random Linear Systems

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

A New Adaptive Control Scheme for Uncertain Nonlinear Systems with Quantized Input Signal

Adaptive Security Tracking Control of Constrained Unmanned Surface Vehicles

Optimal trajectory tracking for uncertain linear discrete‐time systems using time‐varying Q‐learning

A Generalized Trajectory Tracking Controller for Robot Manipulators with Bounded Inputs

Trajectory Tracking of Robot Based on Adaptive Theory

Practical Adaptive Fuzzy Control of Nonlinear Pure-Feedback Systems with Quantized Nonlinearity Input

Analysis of the Forward-Backward Trajectory Solution for the Mixed Quantum-Classical Liouville Equation.

Adaptive Asymptotic Tracking Control for Input-Quantized Nonlinear Systems With Multiple Unknown Control Directions

Adaptive Quantized Tracking Control for a Class of Uncertain Nonlinear Systems

Closed-Loop Designed Open-Loop Control of Quantum Systems: An Error Analysis

A Novel Non-Singular Terminal Sliding Mode Trajectory Tracking Control for Robotic Manipulators

Global Adaptive Tracking for Nonlinearly Parameterized Systems via Quantized Feedback