Abstract:With the construction of the power Internet of Things (IoT), communication between smart devices in urban distribution networks has been gradually moving towards high speed, high compatibility, and low latency, which provides reliable support for reconfiguration optimization in urban distribution networks. Thus, this study proposed a deep reinforcement learning based multi-level dynamic reconfiguration method for urban distribution networks in a cloud-edge collaboration architecture to obtain a real-time optimal multi-level dynamic reconfiguration solution. First, the multi-level dynamic reconfiguration method was discussed, which included feeder-, transformer-, and substation-levels. Subsequently, the multi-agent system was combined with the cloud-edge collaboration architecture to build a deep reinforcement learning model for multi-level dynamic reconfiguration in an urban distribution network. The cloud-edge collaboration architecture can effectively support the multi-agent system to conduct "centralized training and decentralized execution" operation modes and improve the learning efficiency of the model. Thereafter, for a multi-agent system, this study adopted a combination of offline and online learning to endow the model with the ability to realize automatic optimization and updation of the strategy. In the offline learning phase, a Q-learning-based multi-agent conservative Q-learning (MACQL) algorithm was proposed to stabilize the learning results and reduce the risk of the next online learning phase. In the online learning phase, a multi- agent deep deterministic policy gradient (MADDPG) algorithm based on policy gradients was proposed to explore the action space and update the experience pool. Finally, the effectiveness of the proposed method was verified through a simulation analysis of a real-world 445-node system.

Explainable reinforcement learning for distribution network reconfiguration

A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

Reconfiguring Unbalanced Distribution Networks Using Reinforcement Learning over Graphs

Distribution Network Reconfiguration Based on NoisyNet Deep Q-Learning Network

Reinforcement Learning Enabled Microgrid Network Reconfiguration under Disruptive Events

Deep Q-Learning-based Distribution Network Reconfiguration for Reliability Improvement

Safe Reinforcement Learning for Active Distribution Networks Reconfiguration Considering Uncertainty

Safe reinforcement learning method integrating process knowledge for real-time scheduling of gas supply network

A Two-stage Multi-agent Deep Reinforcement Learning Method for Urban Distribution Network Reconfiguration Considering Switch Contribution

Sequential Reconfiguration of Unbalanced Distribution Network with Soft Open Points Based on Deep Reinforcement Learning

Hierarchical Reinforcement Learning for Power Network Topology Control

A Multi-Agent Reinforcement Learning Method for Distribution System Restoration Considering Dynamic Network Reconfiguration

Many-Objective Distribution Network Reconfiguration via Deep Reinforcement Learning Assisted Optimization Algorithm

Reinforcement Learning for Electricity Network Operation

Real-time autonomous dynamic reconfiguration based on deep learning algorithm for distribution network

Deep reinforcement learning based multi-level dynamic reconfiguration for urban distribution network: A cloud-edge collaboration architecture

DNOperNet: A Generic Network Architecture for Scalable and Safe Deep Reinforcement Learning in Distribution Network Operation

Reinforcement Learning for Active Distribution Network Planning Based on Monte Carlo Tree Search

Dynamic Network Reconfiguration for Entropy Maximization using Deep Reinforcement Learning

Real-time outage management in active distribution networks using reinforcement learning over graphs

Reinforcement Learning-Based Net Load Volatility Control of Active Distribution Power Networks