Abstract:Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several sub-networks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each sub-network is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33- and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

Data-Driven Multi-Agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

Multi-Agent Deep Reinforcement Learning for Realistic Distribution System Voltage Control Using PV Inverters

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

Attention Enabled Multi-agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

A Date-Driven Voltage Control Strategy for Distribution Network Using Deep Reinforcement Learning

Multi-agent Graph Reinforcement Learning for Decentralized Volt-VAR Control in Power Distribution Systems

A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Demand Management

Deep Reinforcement Learning Based Coordinated Voltage Control in Smart Distribution Network

A MATD3 -based Voltage Control Strategy for Distribution Networks Considering Active and Reactive Power Adjustment Costs

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

A Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement Learning

Physics-Shielded Multi-Agent Deep Reinforcement Learning for Safe Active Voltage Control with Photovoltaic/Battery Energy Storage Systems

Multi-Agent Deep Reinforcement Learning for Photovoltaics and Battery Storage Aggregators Coordinated Operation in Active Distribution Network with Incomplete Information

Optimal Real-Time Voltage/Var Control for Distribution Network: Droop-control Based Multi-Agent Deep Reinforcement Learning

Data-Driven Distribution System Coordinated PV Inverter Control Using Deep Reinforcement Learning

Coordinated voltage regulation of high renewable-penetrated distribution networks: An evolutionary curriculum-based deep reinforcement learning approach

Multi-Agent Deep Reinforcement Learning-Based Distributed Voltage Control of Flexible Distribution Networks with Soft Open Points