Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

Evolutionary computing assisted deep reinforcement learning for multi-objective integrated energy system management

Distributed optimization of electricity-Gas-Heat integrated energy system with multi-agent deep reinforcement learning

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Optimal Operation of Integrated Energy System Based on Deep Reinforcement Learning

Many-Objective Evolutionary Optimization Based Economic Dispatch of Integrated Energy System with Multi-microgrid and CHP

Deep Reinforcement Learning-based Multi-Scenario Multi-Scale Economic Scheduling for Integrated Energy Systems

Research on Capacity Configuration Optimization of Multi-Energy Complementary System Using Deep Reinforce Learning

Towards Pareto-optimal energy management in integrated energy systems: A multi-agent and multi-objective deep reinforcement learning approach

Optimal operation of regional integrated energy system based on multi-agent deep deterministic policy gradient algorithm

Multi-objective two-stage robust optimization of wind/PV/thermal power system based on meta multi-agent reinforcement learning

Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

Optimal Energy Management of Multi-Microgrids Connected to Distribution System Based on Deep Reinforcement Learning

Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach

Dynamic Dispatch of Hybrid Hydro/PV/PHS Complementary Power Generation System Based on Deep Reinforcement Learning

Dynamic Optimization of on‐Grid Integrated Energy System Considering Peak‐Shaving Demand Via Learning Methods

Multi-agent deep reinforcement learning-based optimal energy management for grid-connected multiple energy carrier microgrids

Distributed energy management of multi-area integrated energy system based on multi-agent deep reinforcement learning

Coordinated optimal dispatching approach for integrated energy system cluster based on improved deep reinforcement learning

Data Driven Solution to Market Equilibrium Via Deep Reinforcement Learning

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism