Abstract:Solving the energy crisis and environmental pollution requires large-scale access to distributed energy and the popularization of electric vehicles. However, distributed energy sources and loads are characterized by randomness, intermittence and difficulty in accurate prediction, which bring great challenges to the security, stability and economic operation of power system. Therefore, this paper explores an integrated energy system model that contains a large amount of new energy and combined cooling heating and power (CCHP) from the perspective of automatic generation control (AGC). Then, a gradient Q(σ,λ) [GQ (σ,λ)] algorithm for distributed multi-region interconnected power system is proposed to solve it. The proposed algorithm integrates unified mixed sampling parameter and linear function approximation on the basis of the Q(λ) algorithm with characteristics of interactive collaboration and self-learning. The GQ (σ,λ) algorithm avoids the disadvantages of large action spaces required by traditional reinforcement learning, so as to obtain multi-region optimal cooperative control. Under such control, the energy autonomy of each region can be achieved, and the strong stochastic disturbance caused by the large-scale access of distributed energy to grid can be resolved. In this paper, the improved IEEE two-area load frequency control (LFC) model and the integrated energy system model incorporating a large amount of new energy and CCHP are used for simulation analysis. Results show that compared with other algorithms, the proposed algorithm has optimal cooperative control performance, fast convergence speed and good robustness, which can solve the strong stochastic disturbance caused by the large-scale grid connection of distributed energy.

Multi-regional Reactive Power Optimization Based on Correlated Equilibrium Q-learning Collaborative Algorithm

Hierarchically correlated equilibrium Q-learning for multi-area decentralized collaborative reactive power optimization

Multi-Agent Correlated Equilibrium Q(λ) Learning for Coordinated Smart Generation Control of Interconnected Power Grids

Automatic generation control for interconnected power grids based on multi-agent correlated equilibrium learning system

Q-learning-based Dynamic Optimal Allocation Algorithm for CPS Order of Interconnected Power Grids

Distributed $Q$ -Learning-based Online Optimization Algorithm for Unit Commitment and Dispatch in Smart Grid

Hierarchical Correlated Q-Learning For Multi-Layer Optimal Generation Command Dispatch

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Reactive Power Optimization Calculation Based On Multi-Step Q(Lambda) Learning Algorithm

Automatic Generation Control for Distributed Multi-Region Interconnected Power System with Function Approximation

Research on a Low-Carbon Optimization Strategy for Regional Power Grids Considering a Dual Demand Response of Electricity and Carbon

Regional Power Grid AGC Control Strategy Research Based on Q-Learning Algorithm under WACPB Mode

Multi-Agent Cooperation Based Reduced-Dimension Q() Learning for Optimal Carbon-Energy Combined-Flow

A Low-carbon Regional Power Dispatch Method with Integration of Renewable Energy Sources

Optimal CPS Command Dispatch Based on Hierarchically Correlated Equilibrium Reinforcement Learning

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Fast Stackelberg Equilibrium Learning for Real-Time Coordinated Energy Control of a Multi-Area Integrated Energy System

Multi-Objective Coordinated Control of Reactive Compensation Devices among Multiple Substations

A method for online reactive power optimization problem in regional power grid

Topsis-Q(Lambda) Learning For Multi-Objective Optimal Carbon Emission Flow Of Power Grid