Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

OPTIMAL ADAPTIVE CONTROLLER FOR MULTIDIMENSIONAL ARMAX MODEL

Modular‐based Adaptive Control of Uncertain Nonlinear Time‐varying Systems with Piecewise Jumping Parameters

A Robust MPC Technique with Adaptive Disturbance Model

Multi-loop Adaptive Internal Model Control Based on a Dynamic Partial Least Squares Model

Multivariable Optimal Control with Adaptation Mechanism in Rudder/fin Stabilizing System

An Engineering-Effective Adaptive Model Algorithm Control (AMAC) and Simulation

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Multiple Model Adaptive Control for a Class of Nonlinear Systems with Unknown Control Directions.

Time-Optimal Constrained Adaptive Robust Control of Single-DOF Mechanical Systems: A Comparative Study with BLF-based Methods

Optimal tracking cooperative control for multi-agent systems with periodic sampling via robust model predictive control approach

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Online Optimization-Based Time-Optimal Adaptive Robust Control of Linear Motors with Input and State Constraints

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Optimal adaptive tracking for stochastic systems

Time-Optimal Constrained Adaptive Robust Control of a Class of SISO Unmatched Nonlinear Systems.

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Optimal adaptive controllers based on least squares algorithms

Fast Trajectory Tracking Control Algorithm for Autonomous Vehicles Based on the Alternating Direction Multiplier Method (ADMM) to the Receding Optimization of Model Predictive Control (MPC)

Approximate Optimal Tracking Control for Partially Unknown Nonlinear Systems via an Adaptive Fixed-Time Observer