Abstract:A reinforcement learning (RL) based fault-tolerant control strategy is developed in this paper for wind turbine torque & pitch control under actuator & sensor faults subject to unknown system models. An incremental model-based heuristic dynamic programming (IHDP) approach, along with a critic-actor structure, is designed to enable fault-tolerance capability and achieve optimal control. Particularly, an incremental model is embedded in the critic-actor structure to quickly learn the potential system changes, such as faults, in real-time. Different from the current IHDP methods that need the intensive evaluation of the state and input matrices, only the input matrix of the incremental model is dynamically evaluated and updated by an online recursive least square estimation procedure in our proposed method. Such a design significantly enhances the online model evaluation efficiency and control performance, especially under faulty conditions. In addition, a value function and a target critic network are incorporated into the main critic-actor structure to improve our method’s learning effectiveness. Case studies for wind turbines under various working conditions are conducted based on the fatigue, aerodynamics, structures, and turbulence (FAST) simulator to demonstrate the proposed method’s solid fault-tolerance capability and adaptability. Note to Practitioners—This work achieves high-performance wind turbine control under unknown actuator & sensor faults. Such a task is still an open problem due to the complexity of turbine dynamics and potential uncertainties in practical situations. A novel data-driven and model-free control strategy based on reinforcement learning is proposed to handle these issues. The designed method can quickly capture the potential changes in the system and adjust its control policy in real-time, rendering strong adaptability and fault-tolerant abilities. It provides data-driven innovations for complex operational tasks of wind turbines and demonstrates the feasibility of applying reinforcement learning to handle fault-tolerant control problems. The proposed method has a generic structure and has the potential to be implemented in other renewable energy systems.

Few-Shot Class-Incremental Learning for System-Level Fault Diagnosis of Wind Turbine

Incremental Learning Method for Wind Turbine Fault Detection Models Considering False Negatives

Diagnosis of wind turbine faults with transfer learning algorithms

SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

SCLIFD: Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

Ordinal few-shot learning with applications to fault diagnosis of offshore wind turbines

Semi-supervised Adversarial Discriminative Learning Approach for Intelligent Fault Diagnosis of Wind Turbine.

A class-imbalance-aware domain adaptation framework for fault diagnosis of wind turbine drivetrains under different environmental conditions

Wind Turbine Fault-Tolerant Control via Incremental Model-Based Reinforcement Learning

A Feature Extension and Reconstruction Method with Incremental Learning Capabilities under Limited Samples for Intelligent Diagnosis

A Cognition-Driven Framework for Few-Shot Class-Incremental Learning

Matching contrastive learning: An effective and intelligent method for wind turbine fault diagnosis with imbalanced SCADA data

Learning deep representation of imbalanced SCADA data for fault detection of wind turbines

Semi-supervised deep learning recognition method for the new classes of faults in wind turbine system

A Modified Deep Convolutional Subdomain Adaptive Network Method for Fault Diagnosis of Wind Turbine Systems

Using information about machine failures to control flowlines

Wind Turbine Fault Detection with Multimodule Feature Extraction Network and Adaptive Strategy

Supervised Transfer Learning Framework for Fault Diagnosis in Wind Turbines

Study on novel signal processing and simultaneous-fault diagnostic method for wind turbine

Adaptive Incremental Diagnosis Model for Intelligent Fault Diagnosis with Dynamic Weight Correction

Semi-supervised class incremental broad network for continuous diagnosis of rotating machinery faults with limited labeled samples