Abstract:With the high penetration of large-scale distributed renewable energy generation, the power system is facing enormous challenges in terms of the inherent uncertainty of power generation of renewable energy resources. In this regard, virtual power plants (VPPs) can play a crucial role in integrating a large number of distributed generation units (DGs) more effectively to improve the stability of the power systems. Due to the uncertainty and nonlinear characteristics of DGs, reliable economic dispatch in VPPs requires timely and reliable communication between DGs, and between the generation side and the load side. The online economic dispatch optimizes the cost of VPPs. In this article, we propose a deep reinforcement learning (DRL) algorithm for the optimal online economic dispatch strategy in VPPs. By utilizing DRL, our proposed algorithm reduced the computational complexity while also incorporating large and continuous state space due to the stochastic characteristics of distributed power generation. We further design an edge computing framework to handle the stochastic and large-state space characteristics of VPPs. The DRL-based real-time economic dispatch algorithm is executed online. We utilize real meteorological and load data to analyze and validate the performance of our proposed algorithm. The experimental results show that our proposed DRL-based algorithm can successfully learn the characteristics of DGs and industrial user demands. It can learn to choose actions to minimize the cost of VPPs. Compared with the deterministic policy gradient algorithm and DDPG, our proposed method has lower time complexity.

Distributed Reactive Power Optimization for Energy Internet via Multiagent Deep Reinforcement Learning With Graph Attention Networks

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Reactive Power Optimization for Transient Voltage Stability in Energy Internet Via Deep Reinforcement Learning Approach

Reactive Power Optimization of Distribution Network Based on Deep Reinforcement Learning and Multi Agent System

Reactive Power Optimization for Voltage Stability in Energy Internet Based on Graph Convolutional Networks and Deep Q-learning

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Multi-agent deep reinforcement learning based distributed control architecture for interconnected multi-energy microgrid energy management and optimization

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework

Real-Time Optimal Scheduling for Active Distribution Networks: A Graph Reinforcement Learning Method

Data-Driven Reactive Power Optimization of Distribution Networks Via Graph Attention Networks

Deep Reinforcement Learning for Economic Dispatch of Virtual Power Plant in Internet of Energy.

Reactive power optimization via deep transfer reinforcement learning for efficient adaptation to multiple scenarios

Coordinated Electric Vehicle Active and Reactive Power Control for Active Distribution Networks

A Graph-based Deep Reinforcement Learning Framework for Autonomous Power Dispatch on Power Systems with Changing Topologies

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Research on Reactive Power Optimization Strategy under the Intelligent Improvement Model of the Distribution Network

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness