Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

An Improved Two-Stage Deep Reinforcement Learning Approach for Regulation Service Disaggregation in a Virtual Power Plant

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Demand Management

Virtual power plant containing electric vehicles scheduling strategies based on deep reinforcement learning

Virtual Power Plant Reactive Power Voltage Support Strategy Based on Deep Reinforcement Learning

Efficient Virtual Power Plant Dispatch Model for Distributed Energy Resources Using Deep Reinforcement Learning

GRU-integrated Constrained Soft Actor-Critic Learning Enabled Fully Distributed Scheduling Strategy for Residential Virtual Power Plant

Robust Federated Deep Reinforcement Learning for Optimal Control in Multiple Virtual Power Plants with Electric Vehicles

Optimizing Multi-Energy Fow Scheduling of Hydrogen-Inclusive Virtual Power Plants Based on Deep Reinforcement Learning under Dual-Carbon Targets

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Deep Reinforcement Learning for Economic Dispatch of Virtual Power Plant in Internet of Energy.

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

Dynamic aggregation strategy for a virtual power plant to improve flexible regulation ability

Integrated Three-Stage Decentralized Scheduling for Virtual Power Plants: A Model-Assisted Multi-Agent Reinforcement Learning Method

Deep Reinforcement Learning for Microgrid Cost Optimization Considering Load Flexibility

An optimal solutions-guided deep reinforcement learning approach for online energy storage control

Distributed flexible resource regulation strategy for residential communities based on deep reinforcement learning

Multi-Agent Deep Reinforcement Learning for Realistic Distribution System Voltage Control Using PV Inverters

On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control

A Virtual Power Plant Economic Scheduling Strategy Based on Deep Reinforcement Learning

An Augmented Lagrangian-based Safe Reinforcement Learning Algorithm for Carbon-Oriented Optimal Scheduling of EV Aggregators

Research on Decision-Making for New Power Systems under the Virtual Power Plant Mechanism