Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

Learning the Optimal Strategy of Power System Operation With Varying Renewable Generations

A Shared Control Approach for Muti-Area Interconnected Power System Via Operational Behaviors Learning

Multi-Objective Optimal Dispatch Of Power Systems Integrated With Intermittent Renewable Energy Considering Demand Response

Physics-Informed Reinforcement Learning for Real-Time Optimal Power Flow with Renewable Energy Resources

Online Optimal Power Scheduling of a Microgrid via Imitation Learning

Review of Learning-Assisted Power System Optimization

Research on Data-Driven Optimal Scheduling of Power System

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Synergistic Integration of Machine Learning and Mathematical Optimization for Unit Commitment

Optimal Power Flow in Highly Renewable Power System Based on Attention Neural Networks

QCQP-Net: Reliably Learning Feasible Alternating Current Optimal Power Flow Solutions Under Constraints

Toward Rapid, Optimal, and Feasible Power Dispatch through Generalized Neural Mapping

Parametric Distribution Optimal Power Flow with Variable Renewable Generation

Learning-Assisted Optimization for Transmission Switching

Dynamic Optimization of on‐Grid Integrated Energy System Considering Peak‐Shaving Demand Via Learning Methods

Multistage Mixed-Integer Robust Optimization for Power Grid Scheduling: An Efficient Reformulation Algorithm

Optimal scheduling model of a virtual power plant based on robust optimization with additional momentum to improve the predictive output of back propagation neural networks

Scheduling Thermostatically Controlled Loads to Provide Regulation Capacity Based on a Learning-Based Optimal Power Flow Model

Imitation Learning Based Real-Time Decision-Making of Microgrid Economic Dispatch under Multiple Uncertainties