Abstract:Solving the energy crisis and environmental pollution requires large-scale access to distributed energy and the popularization of electric vehicles. However, distributed energy sources and loads are characterized by randomness, intermittence and difficulty in accurate prediction, which bring great challenges to the security, stability and economic operation of power system. Therefore, this paper explores an integrated energy system model that contains a large amount of new energy and combined cooling heating and power (CCHP) from the perspective of automatic generation control (AGC). Then, a gradient Q(σ,λ) [GQ (σ,λ)] algorithm for distributed multi-region interconnected power system is proposed to solve it. The proposed algorithm integrates unified mixed sampling parameter and linear function approximation on the basis of the Q(λ) algorithm with characteristics of interactive collaboration and self-learning. The GQ (σ,λ) algorithm avoids the disadvantages of large action spaces required by traditional reinforcement learning, so as to obtain multi-region optimal cooperative control. Under such control, the energy autonomy of each region can be achieved, and the strong stochastic disturbance caused by the large-scale access of distributed energy to grid can be resolved. In this paper, the improved IEEE two-area load frequency control (LFC) model and the integrated energy system model incorporating a large amount of new energy and CCHP are used for simulation analysis. Results show that compared with other algorithms, the proposed algorithm has optimal cooperative control performance, fast convergence speed and good robustness, which can solve the strong stochastic disturbance caused by the large-scale grid connection of distributed energy.

Collaborative Consensus Transfer Q-learning Based Dynamic Generation Dispatch of Automatic Generation Control With Virtual Generation Tribe

Consensus Transfer ${Q}$ -Learning for Decentralized Generation Command Dispatch Based on Virtual Generation Tribe

Virtual Generation Tribe Based Collaborative Consensus Algorithm for Dynamic Generation Dispatch of AGC in Interconnected Power Grids

Virtual generation tribe based robust collaborative consensus algorithm for dynamic generation command dispatch optimization of smart grid

Decentralized Reinforcement Learning Collaborative Consensus Algorithm for Generation Dispatch in Virtual Generation Tribe

Distributed Consensus Based Supply–Demand Balance Algorithm for Economic Dispatch Problem in a Smart Grid with Switching Graph

Deep Interactive Teaching-Learning Optimization Algorithm for Generation Command Dispatch of AGC with High-Penetration Electric Vehicles

Virtual Generation Alliance Automatic Generation Control Based on Deep Reinforcement Learning.

A Virtual Generation Ecosystem Control Strategy for Automatic Generation Control of Interconnected Microgrids.

Automatic Generation Control Based on Multiple-step Greedy Attribute and Multiple-level Allocation Strategy

Hierarchical Correlated Q-Learning For Multi-Layer Optimal Generation Command Dispatch

Q-Learning Approach for Hierarchical Agc Scheme of Interconnected Power Grids

A Wolf Pack Hunting Strategy Based Virtual Tribes Control for Automatic Generation Control of Smart Grid

Q-learning-based Dynamic Optimal Allocation Algorithm for CPS Order of Interconnected Power Grids

Optimal CPS Command Dispatch Based on Hierarchically Correlated Equilibrium Reinforcement Learning

Automatic generation control for interconnected power grids based on multi-agent correlated equilibrium learning system

Lifelong Learning for Complementary Generation Control of Interconnected Power Grids with High-Penetration Renewables and EVs

Stochastic Optimal Generation Command Dispatch Based on Improved Hierarchical Reinforcement Learning Approach

Automatic Generation Control for Distributed Multi-Region Interconnected Power System with Function Approximation

Multi-objective Dynamic Optimal Dispatch Method for CPS Order of Interconnected Power Grids Using Improved Hierarchical Reinforcement Learning