Abstract:A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners—This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.

Reliability Aware Multi-Objective Predictive Control for Wind Farm Based on Machine Learning and Heuristic Optimizations

Multi-Objective Offshore Wind Farm Wake Redirection Optimization for Power Maximization and Load Reduction

Nonlinear Model Predictive Control for Doubly Fed Induction Generator with Uncertainties

Hybrid Intelligent Feedforward-Feedback Pitch Control for VSWT with Predicted Wind Speed

Inverse Optimal Adaptive Neural Power Regulation Control for Variable-Speed Wind Turbines with Load Mitigation

Adaptive Dual-layer Sliding Mode Control for Wind Turbines with Estimated Wind Speed

Effective Wind Speed Estimation and Prediction Based Feedforward Feedback Pitch Control for Wind Turbines.

Reinforcement Learning-Based Multiobjective Control of Grid-Connected Wind Farms

Stratified Progressive Predictive Control Strategy for Multi-objective Dispatching Active Power in Wind Farm

Deep Optimization of Model Predictive Control Performance for Wind Turbine Yaw System Based on Intelligent Fuzzy Deduction

Reactive Power Cooperative Optimization of Wind Farm with Various Reactive Power Compensation Devices

Model predictive control strategy in waked wind farms for optimal fatigue loads

A machine learning-based fatigue loads and power prediction method for wind turbines under yaw control

Smart Cooperative Control Scheme for Large-Scale Wind Farms Based on a Double-Layer Machine Learning Framework

Deep learning-aided model predictive control of wind farms for AGC considering the dynamic wake effect

Wind Turbine Control Strategy Based on Robust Model Predictive Control

Cooperative yaw control of wind farm using a double-layer machine learning framework

Machine-learning-based wind farm optimization through layout design and yaw control

Scalable Optimization for Wind Farm Control using Coordination Graphs

Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning