Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

Optimal Bi-Level Bidding and Dispatching Strategy between Active Distribution Network and Virtual Alliances Using Distributed Robust Multi-Agent Deep Reinforcement Learning

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

A Bi-Level Trading Model for an Active Distribution Company Considering Demand Response Exchange

Stochastic Bi-Level Trading Model for an Active Distribution Company with Dgs and Interruptible Loads

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

Day-Ahead Optimal Dispatch in Active Distribution Network Based on Deep Reinforcement Learning with Improved Feature Extraction Network

A Stochastic Short-Term Operation Model For An Active Distribution Company Considering Network Constraints And Demand Response

Asynchronous Distributed Dynamic Economic Dispatch in Active Distribution Networks

Dispatch and Bidding Strategy of Active Distribution Network in Energy and Ancillary Services Market

Distributed Multiagent Reinforcement Learning With Action Networks for Dynamic Economic Dispatch

Privacy-Preserving Economic Dispatch for an Active Distribution Network with Multiple Networked Microgrids.

Optimal demand response based dynamic pricing strategy via Multi-Agent Federated Twin Delayed Deep Deterministic policy gradient algorithm

Online Voltage Control Strategy: Multi-Mode Based Data-Driven Approach for Active Distribution Networks

Two-Stage Dynamic Alliance Bidding for Incremental Distribution and Retail Companies Based on Complex Network Theory

Decentralized Game-Based Robustly Planning Scheme for Distribution Network and Microgrids Considering Bilateral Energy Trading

Distributed Online Learning and Dynamic Robust Standby Dispatch for Networked Microgrids

A Foresight-Seeing and Transferable Optimization Method for Synergic Operation of Multiple Flexible Resources in Active Distribution Network

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load