Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

Brain-inspired Collaborative Power Dynamic Dispatch for the Digital Twin Smart Generation System

Distributed Real-Time Multi-Objective Control of a Virtual Power Plant in DC Distribution Systems

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Distributed optimization for economic power dispatch with event-triggered communication

Multi-Agent System Based Optimal Power Dispatch Algorithm for Microgrid

Cooperative Game-Based Collaborative Optimal Regulation-Assisted Digital Twins for Wide-Area Distributed Energy

Application of Digital Twin Technology in Auxiliary Decision-making System for Grid-connected Dispatching of New Energy

Distributed Dynamic Programming-Based Approach for Economic Dispatch in Smart Grids

A Multi-agent Technology Based Control Strategy to Prevent Cascading Trips in Large Power Grids

Research on Intelligent Operation and Maintenance System of Battery Based on Digital Twin

Time-space intelligent management and dispatch of electric Beidou based on Beidou and digital twin technology

Coordinated real-time power dispatch for integrated transmission and distribution networks based on model-based optimization and deep reinforcement learning

Digital Twins for the Future Power System: An Overview and a Future Perspective

Design and Implementation of Digital Twin Diesel Generator Systems

Digital Twin and Its Application in Power System

SmartGridDispatchPowered byDeepLearning: ASurvey

Preliminary Exploration on Digital Twin for Power Systems: Challenges, Framework, and Applications

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

SoC-based Digital Twin of Power System Simulation

The Application of Digital Twin on Power Industry

Digital Twin Formation Method for Distributed Generation Plants of Cyber–Physical Power Supply Systems