A deep asynchronous actor‐critic learning‐based event‐triggered decentralized load frequency control of power systems with communication delays

Pengcheng Chen,Shichao Liu,Dan Zhang,Li Yu

DOI: https://doi.org/10.1002/rnc.5516

IF: 3.8973

2021-04-19

International Journal of Robust and Nonlinear Control

Abstract:Abstract This article proposes a novel asynchronous advantage actor‐critic (A3C) learning‐based dynamic event‐triggered mechanism for the decentralized load frequency regulation to alleviate the local‐area communication burden and influence of the load fluctuations. The proposed dynamic event‐triggered mechanism applies the A3C algorithm to optimally adjust the threshold of the event‐triggered function in real time. In the A3C algorithm framework, the long short‐term memory (LSTM) network is used to estimate the policy function and value function. First, for each control area, a novel model of the decentralized load frequency control (LFC) system is established to design the event‐triggered communication mechanism and deal with the communication delay simultaneously. Then, based on the Lyapunov stability theory, the controller gain parameters of the decentralized LFC system and the margins of the even‐triggering thresholds are derived by solving a series of linear matrix inequalities (LMIs). Finally, a three‐area and four‐area power systems are used to evaluate the proposed decentralized LFC method. Simulation results show that the proposed method can greatly reduce the data transmission times and preserve a satisfactory system performance.

automation & control systems,engineering, electrical & electronic,mathematics, applied

What problem does this paper attempt to address?

### Problems Addressed by the Paper

This paper primarily addresses the issue of distributed control in Load Frequency Control (LFC) of power systems under conditions of communication delays and load fluctuations. Specifically, the paper makes the following contributions:

1. **Dynamic Event-Triggered Mechanism**:
- Proposes a dynamic event-triggered mechanism based on the Asynchronous Advantage Actor-Critic (A3C) algorithm to adjust the threshold of the event-triggering function in real-time. This mechanism can reduce the number of data transmissions while ensuring system performance.

2. **Application of Long Short-Term Memory Networks**:
- Utilizes Long Short-Term Memory (LSTM) networks within the A3C algorithm framework to estimate the policy function and value function, thereby optimizing the event-triggering threshold.

3. **Communication Delay and Stability Analysis**:
- Addresses the issue of communication delays by solving a series of Linear Matrix Inequalities (LMIs) to derive the controller gain parameters and event-triggering threshold range for the decentralized LFC system, ensuring system stability.

4. **Simulation Verification**:
- Conducts simulation experiments using 3-area and 4-area power systems. The results show that the proposed method can significantly reduce the number of data transmissions while maintaining good system performance.

In summary, this paper aims to alleviate the communication burden in power systems by introducing a new dynamic event-triggered mechanism and maintain good load frequency control performance in the presence of communication delays and load fluctuations.