Abstract:This paper develops a novel Adaptive Dynammic Programming based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. Adaptive dynamic programming (ADP) based approaches are effective for solving nonlinear Hamilton–Jacobi–Bellman (HJB) in an approximative sense. This paper develops a novel ADP‐based approach, in that the focus is on minimizing the consecutive changes in control inputs over a finite horizon to solve the optimal tracking problem for completely unknown discrete time systems. To that end, the cost function considers within its arguments: tracking performance, energy consumption and as a novelty, consecutive changes in the control inputs. Through suitable system transformation, the optimal tracking problem is transformed to a regulation problem with respect to state tracking error. The latter leads to a novel performance index function over finite horizon and corresponding nonlinear HJB equation that is solved in an approximative iterative sense using a novel iterative ADP‐based algorithm. A suitable Neural network‐based structure is proposed to learn the initial admissible one step zero control law. The proposed iterative ADP is implemented using heuristic dynamic programming technique based on actor‐critic Neural Network structure. Finally, simulation studies are presented to illustrate the effectiveness of the proposed algorithm.

On optimal tracking portfolio in incomplete markets: The reinforcement learning approach

Optimal Tracking Portfolio with A Ratcheting Capital Benchmark

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Reinforcement Learning for Financial Index Tracking

An extended Merton problem with relaxed benchmark tracking

Stochastic control problems with state-reflections arising from relaxed benchmark tracking

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Model-based reinforcement learning for infinite-horizon approximate optimal tracking

Stochastic Control Problems with State Reflections Arising from Relaxed Benchmark Tracking

Optimal consumption under relaxed benchmark tracking and consumption drawdown constraint

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

From deterministic to stochastic: an interpretable stochastic model-free reinforcement learning framework for portfolio optimization

Optimal Tracking Control of Nonlinear Multiagent Systems Using Internal Reinforce Q-Learning

Deep Reinforcement Learning for Stock Portfolio Optimization

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

Continual portfolio selection in dynamic environments via incremental reinforcement learning

Deep differentiable reinforcement learning and optimal trading

Bridging the gap between Markowitz planning and deep reinforcement learning

A Deep Reinforcement Learning Framework For Financial Portfolio Management

Dynamical Hyperparameter Optimization Via Deep Reinforcement Learning in Tracking

Portfolio choice, portfolio liquidation, and portfolio transition under drift uncertainty