Abstract:Solving the energy crisis and environmental pollution requires large-scale access to distributed energy and the popularization of electric vehicles. However, distributed energy sources and loads are characterized by randomness, intermittence and difficulty in accurate prediction, which bring great challenges to the security, stability and economic operation of power system. Therefore, this paper explores an integrated energy system model that contains a large amount of new energy and combined cooling heating and power (CCHP) from the perspective of automatic generation control (AGC). Then, a gradient Q(σ,λ) [GQ (σ,λ)] algorithm for distributed multi-region interconnected power system is proposed to solve it. The proposed algorithm integrates unified mixed sampling parameter and linear function approximation on the basis of the Q(λ) algorithm with characteristics of interactive collaboration and self-learning. The GQ (σ,λ) algorithm avoids the disadvantages of large action spaces required by traditional reinforcement learning, so as to obtain multi-region optimal cooperative control. Under such control, the energy autonomy of each region can be achieved, and the strong stochastic disturbance caused by the large-scale access of distributed energy to grid can be resolved. In this paper, the improved IEEE two-area load frequency control (LFC) model and the integrated energy system model incorporating a large amount of new energy and CCHP are used for simulation analysis. Results show that compared with other algorithms, the proposed algorithm has optimal cooperative control performance, fast convergence speed and good robustness, which can solve the strong stochastic disturbance caused by the large-scale grid connection of distributed energy.

Q-Learning Approach for Hierarchical Agc Scheme of Interconnected Power Grids

A Shared Control Approach for Muti-Area Interconnected Power System Via Operational Behaviors Learning

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Application of Reinforcement Learning Method in a Hydro-thermal Hybrid Automatic Generation Control System

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Research of coordinated optimal control strategy between units and grid based on hierarchical event-driving control

Coordinated automatic generation control of interconnected power system with imitation guided exploration multi-agent deep reinforcement learning

Multi-Stage Transmission Line Flow Control Using Centralized and Decentralized Reinforcement Learning Agents

Automatic Generation Control for Distributed Multi-Region Interconnected Power System with Function Approximation

Application of Q-learning Approach with Prior Knowledge to Non-linear AGC System

Regional Power Grid AGC Control Strategy Research Based on Q-Learning Algorithm under WACPB Mode

A prior knowledge-embedded reinforcement learning method for real-time active power corrective control in complex power systems

Online Cooperative Optimal Power Scheduling of Multiple Microgrids Via Hierarchical Imitation Learning

Multi-agent Hierarchical Deep Reinforcement Learning for Operation Optimization of Grid-interactive Efficient Commercial Buildings

Hierarchical Coordinated Automatic Generation Control Involving Distributed Energy Resources: an Aggregation Approach

Automatic Generation Control Based on Multiple Neural Networks With Actor-Critic Strategy

Closed-Loop Hierarchical Operation for Optimal Unit Commitment and Dispatch in Microgrids: A Hybrid System Approach

Power grid optimal topology dispatch and early fault warning using GAT and HDRL

Distributed Economic Automatic Generation Control: A Game Theoretic Perspective

Scalable Voltage Control using Structure-Driven Hierarchical Deep Reinforcement Learning