Abstract:Photovoltaic output and load uncertainty are prone to cause voltage fluctuations in a distribution network, which can affect the power quality. With a particular focus on the distribution network voltage overrun caused by this problem, we propose a two-stage multi-mode voltage control strategy for distribution networks based on deep reinforcement learning to mitigate voltage fluctuations while realizing coordinated operation among different devices. First, the on-load regulator transformer and capacitor bank are effectively controlled using a centralized control strategy in the day-ahead phase to obtain the optimal tidal current for the distribution network, in order to achieve optimal operation of the long time-scale equipment of the system. Then, a distributed control strategy based on deep reinforcement learning with multiple intelligences is applied to regulate the reactive power of the photovoltaic inverters, based on local observations in the intraday phase, to provide fast, flexible, and reactive power support for the distribution network. Finally, a multi-mode data-driven conversion strategy based on deep reinforcement learning is used to coordinate and convert between different control modes, to enable the system to effectively reduce voltage offsets and reactive power losses under varying operational demand. The proposed method is experimentally validated on an improved IEEE 33-node distribution system, and the results show that it can effectively solve the voltage overrun problem and reduce the reactive power loss in the distribution system.

Multi-Task Reinforcement Learning for Distribution System Voltage Control with Topology Changes

Research on Volt/Var Control of Distribution Networks Based on PPO Algorithm

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

Two-Stage Multi-Mode Voltage Control for Distribution Networks: A Deep Reinforcement Learning Approach Based on Multiple Intelligences

Deep Reinforcement Learning for Electric Transmission Voltage Control

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Robust Deep Reinforcement Learning for Inverter-based Volt-Var Control in Partially Observable Distribution Networks

Coordination of PV Smart Inverters Using Deep Reinforcement Learning for Grid Voltage Regulation

Voltage Control of Distribution Grid with District Cooling Systems Based on Scenario-Classified Reinforcement Learning

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

Reinforcement Learning for Volt-Var Control: A Novel Two-stage Progressive Training Strategy

Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning

Residual Deep Reinforcement Learning for Inverter-based Volt-Var Control

Efficient Learning of Voltage Control Strategies via Model-based Deep Reinforcement Learning

Two-Stage Deep Reinforcement Learning for Inverter-Based Volt-VAR Control in Active Distribution Networks

Deep Reinforcement Leaming for Short-term Voltage Control by Dynamic Load Shedding in China Southem Power Grid

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

Coordinated voltage regulation of high renewable-penetrated distribution networks: An evolutionary curriculum-based deep reinforcement learning approach

Scalable Voltage Control using Structure-Driven Hierarchical Deep Reinforcement Learning