Abstract:In order to enable full participation of high-performance units controlled by different dispatching centers in the performance-based frequency regulation market, a data-driven grid-area coordinated load frequency control (GAC-LFC) strategy using unified performance-based frequency regulation market mechanism is proposed. The strategy takes into account the coordination of LFC controllers in different areas of the interconnected power grid, and accommodates a large number of high-performance units controlled by dispatching centers in secondary frequency regulation. In addition, an effective exploration-based multi-agent deep deterministic policy gradient (EE-MADDPG) algorithm is proposed as the framework algorithm. In this algorithm, the LFC controller controlled by the grid-dispatching center and the LFC controller controlled by the area-dispatching center in each area are treated as different agents. Through centralized training with decentralized execution, the coordination of LFC controllers controlled by different levels of dispatching centers in different areas can be realized. Moreover, the algorithm introduces effective exploration strategies, agents operating on various principles, and artificial intelligence functions based on imitation learning and curriculum learning, which altogether constitute a more robust strategy. Through the simulation of the four-area LFC model of the China Southern Grid (CSG), it is demonstrated that the proposed method can simultaneously call more high-performance units, improve multi-area LFC control performance, and reduce the frequency regulation mileage payment in each area.

Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Automatic Generation Control Strategy with Aggregated Generation Units Based on Mesh Adaptive Multi-Objective Optimization Algorithm

Grid-area coordinated load frequency control strategy using large-scale multi-agent deep reinforcement learning

Emergency fault affected wide-area automatic generation control via large-scale deep reinforcement learning

Coordinated automatic generation control of interconnected power system with imitation guided exploration multi-agent deep reinforcement learning

Optimal operation of regional integrated energy system based on multi-agent deep deterministic policy gradient algorithm

Integrated Energy Cluster Hierarchical Regulation Technology Considering Demand Response

Optimal demand response based dynamic pricing strategy via Multi-Agent Federated Twin Delayed Deep Deterministic policy gradient algorithm

Low-carbon Economic Dispatch of Electricity-Heat-Gas Integrated Energy Systems Based on Deep Reinforcement Learning

Dynamic Agc Units' Dispatching Based On Loss Sensitivity Identification With The Consideration Of Wind Energy

Low Carbon Economic Dispatch of Integrated Electricity-Gas Energy System Based on Proximal Policy Optimization

ADP-Based Decentralized Load Frequency Control Schemes to Multiarea Asynchronous Markov Jumping Power Systems With Experience Replay

Dispatching strategies of AGC units in energy-saving dispatching environment

Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm

Data driven frequency control of isolated microgrids based on priority experience replay soft deep reinforcement learning algorithm

Adaptive distributed auction-based algorithm for optimal mileage based AGC dispatch with high participation of renewable energy

Dynamic Performance-Based Automatic Generation Control Unit Allocation with Frequency Sensitivity Identification