Abstract:The integration of renewable energy (RE) into the active distribution network (ADN) leads to frequent changes in its operational state, requiring the ADN to be more proactive in ensuring system safety and stability. Active distribution network reconfiguration (ADNR) is a method that aims to balance loads and optimize the system's topology. It has been demonstrated that ADNR can optimize generation costs while maintaining system safety and stability. This study investigates different ADNR methods, which can be classified as mathematical, heuristic, and reinforcement learning (RL) methods. However, mathematical and heuristic methods lack incremental knowledge, which results in the optimization process needing to be re-engineered for different ADNR scenarios. Meanwhile, conventional RL methods are theoretically challenging to guarantee safety in both the training and application stages. To address these challenges, we propose a safe reinforcement learning (SRL) framework for ADNR. This framework leverages the domain knowledge of the ADN to establish a robust environment model. Then, it introduces a hybrid interaction process that allows the agent to interact with both the robust environment and the real ADN. Subsequently, an imagination-based SRL algorithm is employed to ensure the safety of the agent's policy. This approach guarantees that the optimal policy will never violate safety constraints. Numerical analysis validates the performance of the proposed framework, which can effectively interact with the ADN without violating safety constraints. Moreover, the results demonstrate comparable performance to conventional RL in terms of generation cost, power loss, and voltage deviation while ensuring the safety of both training and application.

Real-time Operation Optimization in Active Distribution Networks Based on Multi-Agent Deep Reinforcement Learning

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Online Voltage Control Strategy: Multi-Mode Based Data-Driven Approach for Active Distribution Networks

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

Deep Reinforcement Learning Based Optimal Scheduling of Active Distribution System Considering Distributed Generation, Energy Storage and Flexible Load

Deep Reinforcement Learning Based Topology-Aware Voltage Regulation of Distribution Networks with Distributed Energy Storage

MADDPG-Based Active Distribution Network Dynamic Reconfiguration with Renewable Energy

Real-Time Optimal Scheduling for Active Distribution Networks: A Graph Reinforcement Learning Method

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Coordinated voltage regulation of high renewable-penetrated distribution networks: An evolutionary curriculum-based deep reinforcement learning approach

A Date-Driven Voltage Control Strategy for Distribution Network Using Deep Reinforcement Learning

Reactive Power Optimization of Distribution Network Based on Deep Reinforcement Learning and Multi Agent System

A Source-Load-Storage Cooperative Power Regulation Method for Active Distribution Network Based on Deep Reinforcement Learning

Active and Reactive Power Coordinated Control of Active Distribution Networks Based on Prioritized Reinforcement Learning

Volt-VAR Control in Active Distribution Networks Using Multi-Agent Reinforcement Learning

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

Multi-Agent Deep Reinforcement Learning for Photovoltaics and Battery Storage Aggregators Coordinated Operation in Active Distribution Network with Incomplete Information

Reinforcement Learning Based Reactive Power Real-Time Dispatch Optimization in Distribution Networks

Data-Driven Multi-Agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems

Safe Reinforcement Learning for Active Distribution Networks Reconfiguration Considering Uncertainty