Abstract:Wind farm (WF) is gradually required to provide inertial support during frequency events nowadays. Existing WF inertial control methods have exhibited limitations in parameter estimation and optimal control parameter tuning under variable operating conditions. Moreover, traditional model-based methods suffer from computational efficiency problems due to their reliance on repeated iterations or derivative computations in optimization process. Thus, this paper proposes an inertial control method for large-scale WF based on hierarchical distributed hybrid deep-reinforcement learning (HDH-DRL). Firstly, the control objectives for the inertial control are defined, and are decomposed on the basis of wind turbines (WTs) division. Next, this paper presents a HDH-DRL based inertial control framework consisting of two levels. The upper-level control is achieved by the hybrid multi-agent DRL (HMA-DRL) algorithm with hybrid action exploration mechanism and multi-agent coordination. The consensus based lower-level control aims to achieve the consensus convergence of the control through the locally distributed interaction among WTs. Finally, the inertial control processes of the model are exhibited; the influences of DRL algorithms on the control are discussed; the computational speed and solution accuracy of the proposed method are compared with the model-based methods; the multi-scenario applicability and performance in local communication failures of the model are analyzed. The results demonstrate that the proposed method significantly improves the active power response and frequency stability, achieving rapid consensus convergence with a power deviation below 0.3%, surpassing traditional control methods by at least 0.2%; also, it demonstrates superior performance across various scenarios, including transient and steady-state conditions, with frequency enhancements up to 0.30% and exceptional stability under different wind conditions and communication disruptions.

Reinforcement Learning-Based Multiobjective Control of Grid-Connected Wind Farms

Reinforcement Learning-Based Wind Farm Control: Toward Large Farm Applications via Automatic Grouping and Transfer Learning

A Multiagent Reinforcement Learning Approach for Wind Farm Frequency Control

Intelligent Wind Farm Control via Grouping-Based Reinforcement Learning

Model-Free Optimization Scheme for Efficiency Improvement of Wind Farm Using Decentralized Reinforcement Learning

Multi-Objective Offshore Wind Farm Wake Redirection Optimization for Power Maximization and Load Reduction

Cooperative Wind Farm Control With Deep Reinforcement Learning and Knowledge-Assisted Learning

Wind Farm Power Generation Control Via Double-Network-Based Deep Reinforcement Learning

A grouping strategy for reinforcement learning-based collective yaw control of wind farms

Reliability Aware Multi-Objective Predictive Control for Wind Farm Based on Machine Learning and Heuristic Optimizations

Intelligent Fault-Tolerant Active Power Control Using Reinforcement Learning for Offshore Wind Farms

Collective Large-scale Wind Farm Multivariate Power Output Control Based on Hierarchical Communication Multi-Agent Proximal Policy Optimization

Jointly improving energy efficiency and smoothing power oscillations of integrated offshore wind and photovoltaic power: a deep reinforcement learning approach

An inertial control method for large-scale wind farm based on hierarchical distributed hybrid deep-reinforcement learning

Two-stage ADMM-based Distributed Optimal Reactive Power Control Method for Wind Farms Considering Wake Effects

Robust Damping Controller Design in Renewable- Integrated Power System Considering Communication Resilience

Model-Guided Learning for Wind Farm Power Optimization

Scalable Optimization for Wind Farm Control using Coordination Graphs

Wake‐effect aware optimal online control of wind farms: An explicit solution

Data-Driven Wind Farm Volt/VAR Control Based on Deep Reinforcement Learning

Multi-objective two-stage robust optimization of wind/PV/thermal power system based on meta multi-agent reinforcement learning