Abstract:The strong stochastic disturbance caused by large-scale distributed energy access to power grids affects the security, stability and economic operations of the power grid. A novel multiple-step greedy policy based on the consensus Q-learning (MSGP-CQ) strategy is proposed in this paper, which is an automatic generation control (AGC) for distributed energy incorporating multiple-step greedy attribute and multiple-level allocation strategy. The convergence speed and learning efficiency in the MSGP algorithm are accelerated through the predictive multiple-step iteration updating in the proposed strategy, and the CQ algorithm is adopted with collaborative consensus and self-learning characteristics to enhance the adaptability of the power allocation strategy under the strong stochastic disturbances and obtain the total power commands in the power grid and the dynamic optimal allocations of the unit power. The simulations of the improved IEEE two-area load-frequency control (LFC) power system and the interconnected system model of intelligent distribution network (IDN) groups incorporating a large amount of distributed energy show that the proposed strategy can achieve the optimal coordinated control and power allocation in the power grid. The algorithm MSGP-CQ has stronger robustness and faster dynamic optimization speed and can reduce generation costs. Meanwhile it can also solve the strong stochastic disturbance caused by large-scale distributed energy access to the grid compared with some existing intelligent algorithms.

Virtual generation tribe based robust collaborative consensus algorithm for dynamic generation command dispatch optimization of smart grid

Virtual Generation Tribe Based Collaborative Consensus Algorithm for Dynamic Generation Dispatch of AGC in Interconnected Power Grids

Collaborative Consensus Transfer Q-learning Based Dynamic Generation Dispatch of Automatic Generation Control With Virtual Generation Tribe

Optimal Control of Generators and Series Compensators Within Multi-space-time Scale

Decentralized Reinforcement Learning Collaborative Consensus Algorithm for Generation Dispatch in Virtual Generation Tribe

Convergence Speed Analysis and Optimization for Distributed Control of Virtual Power Plant

Consensus Transfer ${Q}$ -Learning for Decentralized Generation Command Dispatch Based on Virtual Generation Tribe

Distributed Virtual Incremental Cost Consensus Algorithm For Economic Dispatch In A Microgrid

Distributed Consensus Based Supply–Demand Balance Algorithm for Economic Dispatch Problem in a Smart Grid with Switching Graph

A Wolf Pack Hunting Strategy Based Virtual Tribes Control for Automatic Generation Control of Smart Grid

A Virtual Generation Ecosystem Control Strategy for Automatic Generation Control of Interconnected Microgrids.

A Dynamic Consensus Algorithm Based Low-Voltage Ride-Through Operation of Power Converters in Grid-Interactive Microgrids

Virtual Generation Alliance Automatic Generation Control Based on Deep Reinforcement Learning.

Robust Collaborative Consensus Algorithm for Decentralized Economic Dispatch with a Practical Communication Network

Consensus Control Strategy with State Predictor for Virtual Synchronous Generators in Isolated Microgrid

Robust Real-Time Distributed Optimal Control Based Energy Management in a Smart Grid

Automatic Generation Control Based on Multiple-step Greedy Attribute and Multiple-level Allocation Strategy

Consensus-Based Distributed Control with Communication Time Delays for Virtual Synchronous Generators in Isolate Microgrid

Incremental Cost Consensus Algorithm in a Smart Grid Environment

A Consensus Based Adaptive Virtual Capacitor Control Strategy for Reactive Power Sharing and Voltage Restoration in Microgrids