Abstract:Summary This article introduces a novel optimal trajectory tracking control scheme designed for uncertain linear discrete‐time (DT) systems. In contrast to traditional tracking control methods, our approach removes the requirement for the reference trajectory to align with the generator dynamics of an autonomous dynamical system. Moreover, it does not demand the complete desired trajectory to be known in advance, whether through the generator model or any other means. Instead, our approach can dynamically incorporate segments (finite horizons) of reference trajectories and autonomously learn an optimal control policy to track them in real time. To achieve this, we address the tracking problem by learning a time‐varying ‐function through state feedback. This ‐function is then utilized to calculate the optimal feedback gain and explicitly time‐varying feedforward control input, all without the need for prior knowledge of the system dynamics or having the complete reference trajectory in advance. Additionally, we introduce an adaptive observer to extend the applicability of the tracking control scheme to situations where full state measurements are unavailable. We rigorously establish the closed‐loop stability of our optimal adaptive control approach, both with and without the adaptive observer, employing Lyapunov theory. Moreover, we characterize the optimality of the controller with respect to the finite horizon length of the known components of the desired trajectory. To further enhance the controller's adaptability and effectiveness in multitask environments, we employ the Efficient Lifelong Learning Algorithm, which leverages a shared knowledge base within the recursive least squares algorithm for multitask ‐learning. The efficacy of our approach is substantiated through a comprehensive set of simulation results by using a power system example.

Time-optimal Dubins trajectory for moving obstacle avoidance

Time Optimal Zermelo's Navigation Problem with Moving and Fixed Obstacles.

Time optimal control in presence of moving obstacles for a Dubins airplane

Efficient Optimization-Based Trajectory Planning for Unmanned Systems in Confined Environments

Time-optimal Guidance for Intercepting Moving Targets by Dubins Vehicles

Shortest Bounded Curvature Trajectory Via A Moving Circle: Theory and Applications

Study of dynamical system based obstacle avoidance via manipulating orthogonal coordinates

An Incremental Strategy for Tractor-Trailer Vehicle Global Trajectory Optimization in the Presence of Obstacles.

Trajectory Optimization under Contact Timing Uncertainties

A Suboptimal and Analytical Solution to Mobile Robot Trajectory Generation Amidst Moving Obstacles

On Time-optimal Trajectories for a Car-like Robot with One Trailer

Suboptimal Trajectory Programming for Unmanned Aerial Vehicles with Dynamic Obstacle Avoidance

A New Algorithm for Optimizing Dubins Paths to Intercept a Moving Target

Duality-based Convex Optimization for Real-time Obstacle Avoidance between Polytopes with Control Barrier Functions

An Optimal and Real-Time Solution to Parameterized Mobile Robot Trajectories in the Presence of Moving Obstacles

Towards Time-Optimal Tunnel-Following for Quadrotors

Real-Time Local Greedy Search for Multiaxis Globally Time-Optimal Trajectory

Time Governors for Safe Path-Following Control

Optimal trajectory tracking for uncertain linear discrete‐time systems using time‐varying Q‐learning

Provably Safe Trajectory Optimization in the Presence of Uncertain Convex Obstacles

Trajectory Tracking and Optimal Obstacle Avoidance of Mobile Agent Based on Data-Driven Control