Abstract:The conventional volt-VAR control (VVC) in distribution systems has limitations in solving the overvoltage problem caused by massive solar photovoltaic (PV) deployment. As an alternative method, VVC using solar PV smart inverters (PVSIs) has come into the limelight, which can respond quickly and effectively to solve the overvoltage problem by absorbing reactive power. However, the network power loss, that is, the sum of line losses in the distribution network, increases with reactive power. Dynamic distribution network reconfiguration (DNR), which hourly controls the network topology by controlling sectionalizing and tie switches, can also solve the overvoltage problem and reduce network loss by changing the power flow in the network. In this study, to improve the voltage profile and minimize the network power loss, we propose a control scheme that integrates the dynamic DNR with volt-VAR control of PVSIs. The proposed control scheme is practically usable for three reasons: Primarily, the proposed scheme is based on a deep reinforcement learning (DRL) algorithm, which does not require accurate distribution system parameters. Furthermore, we propose the use of a heterogeneous multiagent DRL algorithm to control the switches centrally and PVSIs locally. Finally, a practical communication network in the distribution system is assumed. PVSIs only send their status to the central control center, and there is no communication between the PVSIs. A modified 33-bus distribution test feeder reflecting the system conditions of South Korea is used for the case study. The results of this case study demonstrates that the proposed control scheme effectively improves the voltage profile of the distribution system. In addition, the proposed scheme reduces the total power loss in the distribution system, which is the sum of the network power loss and curtailed energy, owing to the voltage violation of the solar PV output.

Research on Volt/Var Control of Distribution Networks Based on PPO Algorithm

Data-Driven Robust Voltage/VAR Control Using PV Inverters in Active Distribution Networks

Volt-VAR Control in Active Distribution Networks Using Multi-Agent Reinforcement Learning

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Coordinated Voltage Regulation by On-Load Tap Changer Operation and Demand Response Based on Voltage Ranking Search Algorithm

Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems

Dynamic DNR and Solar PV Smart Inverter Control Scheme Using Heterogeneous Multi-Agent Deep Reinforcement Learning

Robust Regional Coordination of Inverter-Based Volt/Var Control Via Multi-Agent Deep Reinforcement Learning

Consensus Multi-Agent Reinforcement Learning for Volt-VAR Control in Power Distribution Networks

A Multi-Stage Coordinated Volt-Var Optimization for Integrated and Unbalanced Radial Distribution Networks

Robust Data-driven and Fully Distributed Volt/VAR Control for Active Distribution Networks with Multiple Virtual Power Plants

Reinforcement Learning Based Robust Volt/Var Control in Active Distribution Networks With Imprecisely Known Delay

Research on Optimal Control Strategy of Distributed Photovoltaic Based on Deep Reinforcement Learning

Real-Time Volt/Var Control in Active Distribution Networks With Data-Driven Partition Method

Three-Stage Inverter-Based Peak Shaving and Volt-VAR Control in Active Distribution Networks Using Online Safe Deep Reinforcement Learning

Reinforcement Learning for Volt-Var Control: A Novel Two-stage Progressive Training Strategy

Spatial-Temporal Coordinated Volt/Var Control for Active Distribution Systems

Robust Offline Deep Reinforcement Learning for Volt-Var Control in Active Distribution Networks

Extremum-Seeking Adaptive-Droop for Model-free and Localized Volt-VAR Optimization

Model-free voltage control of active distribution system with PVs using surrogate model-based deep reinforcement learning