Abstract:Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several sub-networks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each sub-network is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33- and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

A Date-Driven Voltage Control Strategy for Distribution Network Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Voltage Control Method for Distribution Network with High Penetration of Renewable Energy

Two-Stage Multi-Mode Voltage Control for Distribution Networks: A Deep Reinforcement Learning Approach Based on Multiple Intelligences

Simplified Deep Reinforcement Learning Based Volt-var Control of Topologically Variable Power System

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Two-stage Voltage Regulation in Power Distribution System Using Graph Convolutional Network-Based Deep Reinforcement Learning in Real Time

Reinforcement Learning-based District Cooling System Control for Voltage Regulation in Distribution Networks.

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Demand Management

High-Speed Voltage Control in Active Distribution Systems with Smart Inverter Coordination and Deep Reinforcement Learning

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

Multi-agent Edge-Learning Based Real-Time Voltage Control for Active Distribution Network with Prediction Uncertainties Tolerance

Multi-Agent Deep Reinforcement Learning for Voltage Control with Coordinated Active and Reactive Power Optimization

Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information