Abstract:The strong stochastic disturbance caused by large-scale distributed energy access to power grids affects the security, stability and economic operations of the power grid. A novel multiple-step greedy policy based on the consensus Q-learning (MSGP-CQ) strategy is proposed in this paper, which is an automatic generation control (AGC) for distributed energy incorporating multiple-step greedy attribute and multiple-level allocation strategy. The convergence speed and learning efficiency in the MSGP algorithm are accelerated through the predictive multiple-step iteration updating in the proposed strategy, and the CQ algorithm is adopted with collaborative consensus and self-learning characteristics to enhance the adaptability of the power allocation strategy under the strong stochastic disturbances and obtain the total power commands in the power grid and the dynamic optimal allocations of the unit power. The simulations of the improved IEEE two-area load-frequency control (LFC) power system and the interconnected system model of intelligent distribution network (IDN) groups incorporating a large amount of distributed energy show that the proposed strategy can achieve the optimal coordinated control and power allocation in the power grid. The algorithm MSGP-CQ has stronger robustness and faster dynamic optimization speed and can reduce generation costs. Meanwhile it can also solve the strong stochastic disturbance caused by large-scale distributed energy access to the grid compared with some existing intelligent algorithms.

Deep Reinforcement Learning Based Multi-Objective Integrated Automatic Generation Control for Multiple Continuous Power Disturbances

Distributed Real-Time Multi-Objective Control of a Virtual Power Plant in DC Distribution Systems

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Virtual Generation Alliance Automatic Generation Control Based on Deep Reinforcement Learning.

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Coordinated automatic generation control of interconnected power system with imitation guided exploration multi-agent deep reinforcement learning

Automatic Generation Control Strategy with Aggregated Generation Units Based on Mesh Adaptive Multi-Objective Optimization Algorithm

Automatic Generation Control Based on Multiple Neural Networks With Actor-Critic Strategy

Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning

Multi-Agent Deep Reinforcement Learning for Sectional AGC Dispatch

Automatic Generation Control Based on Multiple-step Greedy Attribute and Multiple-level Allocation Strategy

Multi-Agent Deep Reinforcement Learning-Based Distributed Optimal Generation Control of DC Microgrids

Integral Reinforcement Learning-Based Adaptive Optimal Automatic Generation Control

Multi-Objective Interval Optimization Dispatch of Microgrid Via Deep Reinforcement Learning

A Multi-Agent Deep Reinforcement Learning-Based “octopus” Cooperative Load Frequency Control for an Interconnected Grid with Various Renewable Units

Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system

Hierarchical Multi-Agent Deep Reinforcement Learning for Multi-Objective Dispatching in Smart Grid

Demand-Side Frequency Control in Power Network Based on Multi-Agent Deep Reinforcement Learning

Integrated Coordinated Optimization Control of Automatic Generation Control and Automatic Voltage Control in Regional Power Grids

A novel multi-agent DDQN-AD method-based distributed strategy for automatic generation control of integrated energy systems