Abstract:Solving the energy crisis and environmental pollution requires large-scale access to distributed energy and the popularization of electric vehicles. However, distributed energy sources and loads are characterized by randomness, intermittence and difficulty in accurate prediction, which bring great challenges to the security, stability and economic operation of power system. Therefore, this paper explores an integrated energy system model that contains a large amount of new energy and combined cooling heating and power (CCHP) from the perspective of automatic generation control (AGC). Then, a gradient Q(σ,λ) [GQ (σ,λ)] algorithm for distributed multi-region interconnected power system is proposed to solve it. The proposed algorithm integrates unified mixed sampling parameter and linear function approximation on the basis of the Q(λ) algorithm with characteristics of interactive collaboration and self-learning. The GQ (σ,λ) algorithm avoids the disadvantages of large action spaces required by traditional reinforcement learning, so as to obtain multi-region optimal cooperative control. Under such control, the energy autonomy of each region can be achieved, and the strong stochastic disturbance caused by the large-scale access of distributed energy to grid can be resolved. In this paper, the improved IEEE two-area load frequency control (LFC) model and the integrated energy system model incorporating a large amount of new energy and CCHP are used for simulation analysis. Results show that compared with other algorithms, the proposed algorithm has optimal cooperative control performance, fast convergence speed and good robustness, which can solve the strong stochastic disturbance caused by the large-scale grid connection of distributed energy.

Coordinated automatic generation control of interconnected power system with imitation guided exploration multi-agent deep reinforcement learning

Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning

Adaptive Inter-Area Oscillation Damping Controller for Multi-Machine Power Systems

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

A Shared Control Approach for Muti-Area Interconnected Power System Via Operational Behaviors Learning

Emergency fault affected wide-area automatic generation control via large-scale deep reinforcement learning

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Automatic Generation Control Strategy with Aggregated Generation Units Based on Mesh Adaptive Multi-Objective Optimization Algorithm

Grid-area coordinated load frequency control strategy using large-scale multi-agent deep reinforcement learning

Automatic Generation Control for Distributed Multi-Region Interconnected Power System with Function Approximation

Automatic Generation Control Based on Multiple Neural Networks With Actor-Critic Strategy

Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system

Coordinated Control of Power System Based on Direct Neural Dynamic Programming Method

Coordinated control of gas supply system in PEMFC based on multi-agent deep reinforcement learning

Research of coordinated optimal control strategy between units and grid based on hierarchical event-driving control

Integrated Coordinated Optimization Control of Automatic Generation Control and Automatic Voltage Control in Regional Power Grids

Distributed Economic Automatic Generation Control: A Game Theoretic Perspective

Application of Reinforcement Learning-Based Adaptive PID Controller for Automatic Generation Control of Multi-Area Power System

Evolutionary Multi Agent Deep Meta Reinforcement Learning Method for Swarm Intelligence Energy Management of Isolated Multi Area Microgrid with Internet of Things

On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control

Low-carbon economic dispatch strategy for integrated electrical and gas system with GCCP based on multi-agent deep reinforcement learning