Abstract:Significant research is achieved by ensuring output tracking along with accurate identification of uncertain parametric uncertainties. In a novel departure from the existing literature, the need for persistency of excitation condition is eliminated. Recent advances in concurrent learning based adaptive controllers have relaxed the persistency of excitation condition required to achieve exponential tracking and parameter estimation error convergence. This was made possible via the use of additional concurrent learning stacks in the parameter estimation algorithm. However, the proposed concurrent learning components, that is, the history stacks, needed to be filled with "selected" values dependent on the actual system states. Therefore, the previously proposed concurrent learning adaptive controllers required the system to be stable initially for a finite time so that the corresponding history stacks can be filled (finite excitation condition). In this work, motivated to remove the finite excitation condition, a novel desired system state based concurrent learning adaptive controller is proposed. In order to remove the system state dependencies in the controller and estimation algorithms, a filtered version of the dynamics and a novel prediction error formulation have been designed. The overall exponential stability, parameter error convergence and boundedness of the system states during closed loop operations are ensured via Lyapunov based arguments. The main advantages of the proposed method are its dependence on the desired system states and the overall stability results that paved the way in removing the need for finite excitation condition. Numerical studies performed on a two link robotic device are also presented to illustrate the feasibility of the proposed method.

Adaptive Observation-Based Efficient Reinforcement Learning for Uncertain Systems

Successive Convex Approximation Based Off-Policy Optimization for Constrained Reinforcement Learning

A Dual Adaptive Robust Control for Nonlinear Systems with Parameter and State Estimation

A novel observer-based reinforcement learning for uncertain nonlinear systems with disturbances

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

Adaptive Actor-Critic Based Optimal Regulation for Drift-Free Uncertain Nonlinear Systems

Adaptive Reinforcement Learning Strategy-Based Sliding Mode Control of Uncertain Euler-Lagrange Systems with Prescribed Performance Guarantees: Autonomous Underwater Vehicles-Based Verification

Model-based reinforcement learning for infinite-horizon approximate optimal tracking

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

A Recurrent Reinforcement Learning Approach Applicable To Highly Uncertain Environments

Efficient Reinforcement Learning with Impaired Observability: Learning to Act with Delayed and Missing State Observations

Adaptive Optimal Consensus Control of Multiagent Systems with Unknown Dynamics and Disturbances Via Reinforcement Learning

Mixed Reinforcement Learning with Additive Stochastic Uncertainty

Data-based reinforcement learning approximate optimal control for an uncertain nonlinear system with control effectiveness faults

Composite Observer-Based Optimal Attitude-Tracking Control With Reinforcement Learning for Hypersonic Vehicles

Adaptive control of A class of nonlinear systems with guaranteed parameter estimation: A concurrent learning based approach

Optimal Tracking Control of Heterogeneous MASs Using Event-Driven Adaptive Observer and Reinforcement Learning

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Online inverse reinforcement learning with unknown disturbances

Fuzzy Adaptive Tracking of Constrained Nonlinear Systems with Event-Sampling Reinforcement Learning

Uncertainty-Aware Model-Based Reinforcement Learning with Application to Autonomous Driving