Abstract:Since the existence of fractional order dynamics, it is difficult to obtain an optimality equation to solve for fractional-order optimal control. In this paper, a fractional Hamilton-Jacobi-Bellman (HJB) equation based on error derivative is proposed, and a corresponding online learning algorithm is designed. The scheme can handle the optimal tracking problem for the $0<\alpha\leq1$ order nonlinear systems. Since the traditional quadratic cost function is unbounded at infinite time and the optimal control derived from the discounted cost function fails to stabilize the system asymptotically, a cost function based on the error derivative is proposed, which can avoid these problems, and the system is not restricted to be zero equilibrium. Then, the fractional HJB equation is derived by constructing an auxiliary signal without directly using the chain rule of differentiation. The optimality, stability and convergence of its solution are proved, and actor-critic neural networks (NNs) are established to perform the RL algorithm. Finally, the algorithm is applied to a chaotic magnetic-field electromechanical transducer (MFET) system to verify the effectiveness and advantages Note to Practitioners—In engineering, fractional-order dynamics properties are used in many practical systems such as chaotic MFET systems, chaotic arch micro-electro-mechanical systems and fractional order resonant controllers, etc. For these fractional-order systems, traditional integer-order control methods cannot be applied. Moreover, optimal performance with minimal cost/resources can be achieved through optimal control. Therefore, a intelligent control method based on reinforcement learning is proposed in this paper to realize the optimal control for fractional-order systems. The proposed method is applicable to most fractional-order systems and can achieve stable control while optimizing the objective performance and reducing energy consumption. Finally, the proposed algorithm is successfully applied to the chaotic MFET systems.

Fractional-Order Control Method Based on Twin-Delayed Deep Deterministic Policy Gradient Algorithm

Stochastic Averaging Technique for SDOF Strongly Nonlinear Systems with Delayed Feedback Fractional-Order PD Controller

Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems

Reinforcement Learning Control of Hydraulic Servo System Based on TD3 Algorithm

Fractional-Order Systems Optimal Control via Actor-Critic Reinforcement Learning and Its Validation for Chaotic MFET

Adaptive Backstepping Control for Fractional-Order Nonlinear Systems with External Disturbance and Uncertain Parameters Using Smooth Control

Optimization of Robotic Arm Grasping through Fractional-Order Deep Deterministic Policy Gradient Algorithm

Event-Triggered Adaptive Neural Network Backstepping Sliding Mode Control for Fractional Order Chaotic Systems Synchronization With Input Delay

Sliding-Mode Disturbance Observer-Based Control for Fractional-Order System with Unknown Disturbances.

Fractional-Order Model-Free Adaptive Control with High Order Estimation

Model Free Deep Deterministic Policy Gradient Controller for Setpoint Tracking of Non-minimum Phase Systems

Fractional order [PI] Controller and Smith-like Predictor Design for A Class of High Order Systems.

Data-driven integral sliding mode predictive control with optimal disturbance observer

Active disturbance rejection control for fractional-order system.

Observer-based Adaptive Fuzzy Control for Nonlinear Fractional-Order Systems via Backstepping and Sliding Mode Techniques

Fractional Order Systems Time-Optimal Control and Its Application

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm

Fractional-order fuzzy sliding mode control of uncertain nonlinear MIMO systems using fractional-order reinforcement learning

A projection recurrent neural network based sliding mode control to stabilize unknown fractional-order chaotic systems

Distributed auto disturbances rejection resilient control of permanent magnetic maglev trains based on the optimized deep deterministic policy gradient algorithm

Synchronization of Fractional Order Chaotic Systems Via a Novel Sliding Mode Control