Abstract:The virtual synchronous generator (VSG) is an important concept and primary control method in modern power systems. The penetration of power-electronics-based distributed generators in the power grid provides uncertainty and reduces the inertia of the system, thus increasing the risk of instability when disturbance occurs. The VSG produces virtual inertia by introducing the dynamic characteristics of the synchronous generator, which provides inertia and becomes a grid-forming control method. The disadvantages of the VSG are that there are many parameters to be adjusted and its operation process is complicated. However, with the rapid development of artificial intelligence (AI) technology, the powerful adaptive learning capability of AI algorithms provides potential solutions to this issue. Two research hotspots are deep learning (DL) and reinforcement learning (RL). This paper presents a comprehensive review of these two techniques combined with VSG control in the energy internet (EI). Firstly, the basic principle and classification of the VSG are introduced. Next, the development of DL and RL algorithms is briefly reviewed. Then, recent research on VSG control based on DL and RL algorithms are summarized. Finally, some main challenges and study trends are discussed.

What problem does this paper attempt to address?

The paper primarily explores the combined application of Virtual Synchronous Generator (VSG) control technology with Deep Learning (DL) and Reinforcement Learning (RL) methods. Specifically, the paper aims to address the following key issues: 1. **Improving the stability and adaptability of the power system**: As the proportion of renewable energy generation (such as wind and solar power) in the grid continues to increase, traditional large-scale thermal power plants are gradually being replaced by Distributed Generators (DGs). These distributed generation units, based on power electronic devices, reduce the system's inertia and increase the risk of instability when disturbances occur. 2. **Overcoming the limitations of VSG technology**: VSG technology improves system stability by simulating the behavior of traditional synchronous generators to provide virtual inertia. However, VSG technology has drawbacks such as complex parameter adjustment and cumbersome operation processes. 3. **Optimizing VSG control using artificial intelligence technology**: Given the rapid development of artificial intelligence technology (especially DL and RL) and its powerful adaptive learning capabilities, the paper attempts to explore how these technologies can be applied to VSG control to overcome the aforementioned limitations and improve the overall performance of the power system. 4. **Comprehensive review and future trends**: The paper provides a comprehensive review of existing literature, summarizing the applications of DL and RL algorithms in both single VSG systems and multiple VSG systems, and discusses the current challenges and future research trends. In short, the goal of this paper is to study how to use DL and RL technologies to optimize VSG control strategies in the context of power systems, thereby enhancing the stability and flexibility of the entire energy internet.

Deep and Reinforcement Learning in Virtual Synchronous Generator: A Comprehensive Review

Deep Reinforcement Learning Based Adaptive Control Strategy for Virtual Synchronous Generator

Improved Power Decoupling Control Strategy Based on Virtual Synchronous Generator

Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach

Reinforcement learning for electric vehicle applications in power systems:A critical review

Research on Decision-Making for New Power Systems under the Virtual Power Plant Mechanism

Implementing Deep Reinforcement Learning-Based Grid Voltage Control in Real-World Power Systems: Challenges and Insights

A Critical Review of Safe Reinforcement Learning Techniques in Smart Grid Applications

Virtual Inertia Control of the Virtual Synchronous Generator: A Review

Deep Q-Network Based Adaptive Robustness Parameters for Virtual Synchronous Generator

Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning

Overview of Virtual Synchronous Generators: Existing Projects, Challenges, and Future Trends

Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations

Safe Reinforcement Learning for Power System Control: A Review

Review of Deep Reinforcement Learning and Its Application in Modern Renewable Power System Control

Virtual Generation Alliance Automatic Generation Control Based on Deep Reinforcement Learning.

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Deep Reinforcement Learning Based Parameter Self-Tuning Control Strategy for VSG

Deep Reinforcement Learning for Power System Applications: An Overview

Deep Reinforcement Learning for Smart Grid Operations: Algorithms, Applications, and Prospects

An Improved Two-Stage Deep Reinforcement Learning Approach for Regulation Service Disaggregation in a Virtual Power Plant