Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

Finite‐Horizon Ε‐optimal Tracking Control of Discrete‐Time Linear Systems Using Iterative Approximate Dynamic Programming

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

Data-driven finite-horizon optimal tracking control scheme for completely unknown discrete-time nonlinear systems.

Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

Approximate optimal tracking control for continuous-time unknown nonlinear systems

Optimal Tracking Control for a Class of Discrete-Time Nonlinear Systems Based on Ε-Adp

Finite Horizon Optimal Control of Non-Linear Discrete-Time Switched Systems Using Adaptive Dynamic Programming with Ε-Error Bound.

Finite-approximation-error-based Discrete-Time Iterative Adaptive Dynamic Programming.

Nearly Finite-Horizon Optimal Control for A Class of Nonaffine Time-Delay Nonlinear Systems Based on Adaptive Dynamic Programming

Incremental Adaptive Dynamic Programming for Approximate Optimal Tracking Control: a Decoupled and Model-Free Approach

Optimal control for a class of nonlinear system with controller constraints based on finite-approximation-errors ADP algorithm

Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems

Finite Horizon Robust Optimal Tracking Control Based on Approximate Dynamic Programming for Switched Systems with Uncertainties

Decentralized optimal tracking control for large-scale nonlinear systems with tracking error constraints

Data-Driven Finite-Horizon $H_{}$ Tracking Control With Event-Triggered Mechanism for the Continuous-Time Nonlinear Systems

Optimal fixed-point tracking control for discrete-time nonlinear systems via ADP

Optimal Tracking Control For A Class Of Continuous Time Complex-Valued Systems Based On Adaptive Dynamic Programming Algorithm

Further Results on Optimal Tracking Control for Nonlinear Systems with Nonzero Equilibrium Via Adaptive Dynamic Programming

Optimal Tracking Control for Uncertain Nonlinear Systems with Prescribed Performance Via Critic-Only ADP