Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

Energy Storage Backup Power Control Strategy Based on Improved Deep Reinforcement Learning Algorithm

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

A Control Strategy Based on Deep Reinforcement Learning Under the Combined Wind-Solar Storage System

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

An adaptive active power rolling dispatch strategy for high proportion of renewable energy based on distributed deep reinforcement learning

Virtual power plant containing electric vehicles scheduling strategies based on deep reinforcement learning

Improved Deep Q-Network for User-Side Battery Energy Storage Charging and Discharging Strategy in Industrial Parks

Research on Decision-Making for New Power Systems under the Virtual Power Plant Mechanism

Tracking Photovoltaic Power Output Schedule of the Energy Storage System Based on Reinforcement Learning

An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems

Deep Reinforcement Learning Based Adaptive Control Strategy for Virtual Synchronous Generator

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Research on priority scheduling strategy for smoothing power fluctuations of microgrid tie‐lines based on PER‐DDPG algorithm

Hybrid Energy Storage Control Method For DC Microgrid Based On Deep Deterministic Policy Gradient

Research on Energy Management in Hydrogen–Electric Coupled Microgrids Based on Deep Reinforcement Learning

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid Systems

Active power balance control of wind-photovoltaic-storage power system based on transfer learning double deep Q-network approach

An Energy Management Strategy Based on DDPG with Improved Exploration for Battery/Supercapacitor Hybrid Electric Vehicle