Abstract:With the construction of the power Internet of Things (IoT), communication between smart devices in urban distribution networks has been gradually moving towards high speed, high compatibility, and low latency, which provides reliable support for reconfiguration optimization in urban distribution networks. Thus, this study proposed a deep reinforcement learning based multi-level dynamic reconfiguration method for urban distribution networks in a cloud-edge collaboration architecture to obtain a real-time optimal multi-level dynamic reconfiguration solution. First, the multi-level dynamic reconfiguration method was discussed, which included feeder-, transformer-, and substation-levels. Subsequently, the multi-agent system was combined with the cloud-edge collaboration architecture to build a deep reinforcement learning model for multi-level dynamic reconfiguration in an urban distribution network. The cloud-edge collaboration architecture can effectively support the multi-agent system to conduct "centralized training and decentralized execution" operation modes and improve the learning efficiency of the model. Thereafter, for a multi-agent system, this study adopted a combination of offline and online learning to endow the model with the ability to realize automatic optimization and updation of the strategy. In the offline learning phase, a Q-learning-based multi-agent conservative Q-learning (MACQL) algorithm was proposed to stabilize the learning results and reduce the risk of the next online learning phase. In the online learning phase, a multi- agent deep deterministic policy gradient (MADDPG) algorithm based on policy gradients was proposed to explore the action space and update the experience pool. Finally, the effectiveness of the proposed method was verified through a simulation analysis of a real-world 445-node system.

Time-segmented Multi-level Reconfiguration in Distribution Network: A Novel Cloud-edge Collaboration Framework

MDP-Based Distribution Network Reconfiguration with Renewable Distributed Generation: Approximate Dynamic Programming Approach

Research of dynamic reconfiguration of feeder based the dynamic particle swarm optimization algorithm

Directed Graph-Based Distribution Network Reconfiguration for Operation Mode Adjustment and Service Restoration Considering Distributed Generation

Collaborative Optimization of Resident Load Based on Cloud-edge-terminal

Dynamic Reconfiguration of Distribution Network with PV Generation Prediction Based on Credibility Theory

Network Reconfiguration Based on an Edge-Cloud-Coordinate Framework and Load Forecasting

Deep reinforcement learning based multi-level dynamic reconfiguration for urban distribution network: A cloud-edge collaboration architecture

Joint Planning of Energy Storage and Distribution System Considering Network Reconfiguration

Three-Phase Unbalanced Distribution Network Dynamic Reconfiguration: A Distributionally Robust Approach

Research on Partitioning Real-Time Reactive Power Optimization Method for Distribution Network with Renewable Energy

Combining multi-step reconfiguration with many-objective reduction as iterative bi-level scheduling for stochastic distribution network

A Distribution Network Reconfiguration Method Based on the Representative Daily Load Curve

A NEW MULTI-OBJECTIVE ALGORITHM FOR DISTRIBUTION NETWORK RECONFIGURATION

Dynamic reconfiguration of distribution network with new energy generation considering economic and reliability

Enhancing Voltage Compliance in Distribution Network under Cloud and Edge Computing Framework

A dynamic reconfiguration model and method for load balancing in the snow-shaped distribution network

Decomposition-Coordination-Based Voltage Control for High Photovoltaic-Penetrated Distribution Networks under Cloud-Edge Collaborative Architecture

Real-time distributed dispatch strategy for distribution transformer supply zone cluster based on cloud-edge collaboration architecture

An Decomposition Algorithm for Distribution Network Reconfiguration Schedule Considering Demand Response

Dynamic reconfiguration of distribution network considering the uncertainty of distributed generation and loads