Abstract:The objective of the authors' study is to investigate a dual‐layer optimization model for the economic viability and operational stability of distribution system operators and virtual power plants. To address this issue, the authors have introduced a parameter‐sharing deep reinforcement learning algorithm. Through case studies and comparisons with traditional model‐based algorithms and heuristic algorithms, the authors have demonstrated the excellent performance of their proposed method in terms of both efficiency and solution accuracy. The authors' aim is to enhance the benefits and operational efficiency for market participants while providing valuable insights for decision‐makers and researchers in this field. With the increasing integration of distributed energy resources (DERs) into distribution systems, the optimization of system operation has become complex, facing challenges such as inadequate consideration of market participants' benefits, poor computational efficiency, and data privacy concerns. This paper introduces the concept of a virtual power plant (VPP) as a solution for energy integration and management. To strike a balance between operational safety and the interests of market participants, a dual‐layer model is proposed. This model considers the benefits of both Distribution System Operators (DSO) and VPP, while also enhancing the consideration of distribution network constraints. The DSO considers AC optimal power flow and utilizes penalty functions to ensure network security in case of violations. To enhance computational efficiency and privacy, the paper presents the parameter‐sharing twin delayed deep deterministic policy gradient approach. This approach allows multiple intelligent agents to share a neural network model, effectively reducing the computational load. During the training process, only essential data is exchanged among the agents, ensuring the privacy of sensitive information. The effectiveness of the proposed model and the algorithm is validated through a case study on an IEEE 33‐node system.

A Privacy-Preserving Federated Reinforcement Learning Method for Multiple Virtual Power Plants Scheduling

Robust Federated Deep Reinforcement Learning for Optimal Control in Multiple Virtual Power Plants with Electric Vehicles

Privacy-Preserving and Hierarchically Federated Framework for Short-Term Residential Load Forecasting

Byzantine-Resilient Economical Operation Strategy Based on Federated Deep Reinforcement Learning for Multiple Electric Vehicle Charging Stations Considering Data Privacy

Collaborative operation optimization of distribution system and virtual power plants using multi‐agent deep reinforcement learning with parameter‐sharing mechanism

Peer-to-peer privacy-preserving vertical federated learning without trusted third-party coordinator

Privacy-Preserving Power Consumption Prediction Based on Federated Learning with Cross-Entity Data

Federated Reinforcement Learning for smart and privacy-preserving energy management of residential microgrids clusters

Federated Deep Q-Network for Multiple Microgrids Energy Management

A Multi-Agent Deep-Reinforcement-Learning-Based Strategy for Safe Distributed Energy Resource Scheduling in Energy Hubs

PVFL: Verifiable Federated Learning and Prediction with Privacy-Preserving

Federated Reinforcement Learning for Decentralized Voltage Control in Distribution Networks

Distributed differentially private energy management of virtual power plants

Personalized Federated Hypernetworks for Privacy Preservation in Multi-Task Reinforcement Learning

Privacy-Preserving Probabilistic Voltage Forecasting in Local Energy Communities

Adaptive personalized federated reinforcement learning for multiple-ESS optimal market dispatch strategy with electric vehicles and photovoltaic power generations

Deep Reinforcement Learning-Assisted Federated Learning for Robust Short-Term Load Forecasting in Electricity Wholesale Markets

A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Prediction

Privacy-Preserving Distributed Learning for Residential Short-Term Load Forecasting

Achieving Privacy-Preserving Online Multi-Layer Perceptron Model in Smart Grid