Abstract:A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners—This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.

Fault-Tolerant Optimal Tip-Speed-Ratio Tracking Control of Wind Turbines Subject to Actuation Failures

Effective Wind Speed Estimation Based Maximum Power Point Tracking Control for Variable-Speed Wind Turbine

Adaptive Dual-layer Sliding Mode Control for Wind Turbines with Estimated Wind Speed

Adaptive Continuous Neural Pitch Angle Control for Variable‐Speed Wind Turbines

Inverse Optimal Adaptive Neural Power Regulation Control for Variable-Speed Wind Turbines with Load Mitigation

Bounded UDE Based MPPT Control for Wind Turbines

Adaptive power acquisition control of variable-speed wind energy conversion systems under inaccurate wind speed measurement

An Improved Optimal Torque Control Based on Estimated Wind Speed for Wind Turbines

Hybrid Intelligent Feedforward-Feedback Pitch Control for VSWT with Predicted Wind Speed

Hierarchical Robust Adaptive Control for Wind Turbines with Actuator Fault

Adaptive control of variable-speed wind energy conversion systems with inaccurate wind speed measurement

Non-Singular Fast Terminal Sliding Mode and Adaptive Robust Method

Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning

Fixed- Time Adaptive Neural Pitch Angle Control for Variable-Speed Wind Turbines

Design and Control of the Mechanical-Hydraulic Hybrid Transmission System in Wind Turbines

Pitch angle control with fault diagnosis and tolerance for wind turbine generation systems

Optimal and Robust Fault Tolerant Control of Wind Turbines Working under Sensor, Actuator, and System Faults

Adaptive Power Tracking Control Based on Dynamic Sensor Estimation for Energy Conversion Systems

Robust Speed Control Methodology for Variable Speed Wind Turbines

Optimal Power Tracking Control of a Hydraulic Wind Turbine Based on Active Disturbance Rejection Control Methodology

Adaptive PID Control of Wind Turbines for Power Regulation With Unknown Control Direction and Actuator Faults