Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

Knowledge-Based Profit Distribution And Bi-Level Principal-Agent Supervisory Model Of Virtual Enterprises

Adjustable Space Modeling and Real-time Optimal Control of Virtual Power Plant

Distributed Bayesian Network Trust Model in Virtual Network

Multi-agent VPP Coordinated Control Optimization and Risk Analysis Based on the Interactive Algorithm

A Market-Based Bidding and Scheduling Model for Architectural Virtual Power Plants in the Carbon-Electricity-Reserve Joint Market

Modeling and Simulation of Knowledge Transfer within an Inter-firm Network

Model Analysis on Moral Hazard Related with Knowledge Transfer in Virtual R&D Organizations

The Principal-Agent Model Of Knowledge Sharing Within Enterprises

The Cooperation Mechanism and Operating Model of Virtual Business

Research On The Strategy Of Profit Distribution Among Partners In Virtual Enterprise Based On The Fuzzy Shapley Value

Study on Revenue Sharing Contract in Virtual Enterprises

Simulation Study of Inter-Firm Network Knowledge Transfer Moderated by the Proximity

Monitoring in Revenue Sharing Contract of Virtual Enterprises

Control Rights Allocation in Virtual Enterprises Based on Revenue Sharing

Double Layer Dynamic Game Bidding Mechanism Based on Multi-Agent Technology for Virtual Power Plant and Internal Distributed Energy Resource

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

Profit Allocation Strategy of Virtual Power Plant Based on Multi-Objective Optimization in Electricity Market

Bi-Level Programming for Optimal Operation of an Active Distribution Network with Multiple Virtual Power Plants

Optimal Bi-Level Bidding and Dispatching Strategy between Active Distribution Network and Virtual Alliances Using Distributed Robust Multi-Agent Deep Reinforcement Learning

Modeling of a Cooperation Environment in a Virtual Enterprise

Studies On Agent-Based Cooperation For Virtual Enterprises