Proximal Policy Optimization-Based Power Grid Structure Optimization for Reliable Splitting

Xinwei Sun,Shuangteng Han,Yuhong Wang,Yunxiang Shi,Jianquan Liao,Zongsheng Zheng,Xi Wang,Peng Shi

DOI: https://doi.org/10.3390/en17040834

IF: 3.2

2024-02-09

Energies

Abstract:When systems experience a severe fault, splitting, as the final line of defense to ensure the stability of the power system, holds immense significance. The precise selection of splitting sections has become the current focal point of research. Addressing the challenges of a large search space and unclear splitting sections, this paper introduces a grid structure optimization algorithm based on electrical coupling degree. Firstly, employing the theory of slow coherency, a generalized characteristic analysis of the system is conducted, leading to an initial division of coherency groups. Subsequently, an electrical coupling degree index, taking into account the inertia of generators, is proposed. This index can reflect the clarity of grid splitting. Furthermore, a two-layer optimization model for grid structure is constructed, utilizing the Proximal Policy Optimization (PPO) algorithm to optimize the grid structure. This process reduces the size of the splitting space and mitigates the difficulty of acquiring splitting sections. Finally, simulation validation is performed using the IEEE-118-bus system to demonstrate the effectiveness of the proposed optimization algorithm.

energy & fuels

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address the issue of how to effectively select splitting sections to ensure the stable operation of the power grid during severe faults. Specifically, the paper focuses on the following key points:

1. **Complexity of Large-Scale Power Grids**: As power systems become increasingly complex, traditional splitting control methods struggle to adapt and efficiently find suitable splitting sections in the face of large-scale, flexible operating modes and various fault scenarios.

2. **Difficulty in Selecting Splitting Sections**: Existing splitting control methods are usually based on offline simulation analysis or operational experience to pre-determine vulnerable parts of the grid and install splitting devices. However, this approach lacks flexibility and adaptability when dealing with different types of faults, leading to imprecise selection of splitting sections.

3. **Optimization of Splitting Space**: The paper proposes a power grid structure optimization algorithm based on electrical coupling degree, which reduces the size of the splitting space and improves the efficiency and accuracy of selecting splitting sections.

4. **Improving the Reliability of Splitting Control**: By introducing the Proximal Policy Optimization (PPO) algorithm, a two-layer optimization model is constructed to optimize the power grid structure, thereby enhancing the reliability and stability of splitting control.

### Solution Overview

1. **Preliminary Clustering Analysis**: Generalized eigenvalue analysis is performed using slow coherency theory to preliminarily divide the system into coherent groups.
2. **Electrical Coupling Degree Index**: An electrical coupling degree index considering generator inertia is proposed to reflect the clarity of the splitting sections.
3. **Two-Layer Optimization Model**:
- **Lower Layer Model**: A splitting section solving model is constructed based on electrical coupling degree and minimum imbalance power.
- **Upper Layer Model**: A power grid structure optimization model is constructed based on the electrical coupling degree index and voltage stability.
4. **Application of PPO Algorithm**: The PPO algorithm is used to optimize the power grid structure. By interacting with the environment, the strategy network and value function are continuously updated, ultimately outputting an optimized power grid structure scheme.

### Experimental Verification

The paper verifies the effectiveness of the proposed power grid structure optimization algorithm through fault simulation on the IEEE-118 bus system. The experimental results show that the optimized power grid structure has higher efficiency and accuracy in selecting splitting sections, better coping with severe faults, and ensuring the stable operation of the power grid.