Abstract:Active Voltage Control (AVC) on the Power Distribution Networks (PDNs) aims to stabilize the voltage levels to ensure efficient and reliable operation of power systems. With the increasing integration of distributed energy resources, recent efforts have explored employing multi-agent reinforcement learning (MARL) techniques to realize effective AVC. Existing methods mainly focus on the acquisition of short-term AVC strategies, i.e., only learning AVC within the short-term training trajectories of a singular diurnal cycle. However, due to the dynamic nature of load demands and renewable energy, the operation states of real-world PDNs may exhibit significant distribution shifts across varying timescales (e.g., daily and seasonal changes). This can render those short-term strategies suboptimal or even obsolete when performing continuous AVC over extended periods. In this paper, we propose a novel temporal prototype-aware learning method, abbreviated as TPA, to learn time-adaptive AVC under short-term training trajectories. At the heart of TPA are two complementary components, namely multi-scale dynamic encoder and temporal prototype-aware policy, that can be readily incorporated into various MARL methods. The former component integrates a stacked transformer network to learn underlying temporal dependencies at different timescales of the PDNs, while the latter implements a learnable prototype matching mechanism to construct a dedicated AVC policy that can dynamically adapt to the evolving operation states. Experimental results on the AVC benchmark with different PDN sizes demonstrate that the proposed TPA surpasses the state-of-the-art counterparts not only in terms of control performance but also by offering model transferability. Our code is available at <a class="link-external link-https" href="https://github.com/Canyizl/TPA-for-AVC" rel="external noopener nofollow">this https URL</a>.

Adaptive Stepping PTA for DC Analysis Based on Reinforcement Learning.

OSSP-PTA: an Online Stochastic Stepping Policy for PTA on Reinforcement Learning

Training for More Robust and Practical Adaptive Signal Control Models

Dynamic Control of Three-Phase Dual-Active-Bridge DC-DC Converters Based on Sliding-Mode-Learning Adaline

ISPT-Net: A Noval Transient Backward-Stepping Reduction Policy by Irregular Sequential Prediction Transformer

BoA-PTA: A Bayesian Optimization Accelerated PTA Solver for SPICE Simulation

Alleviating Imbalanced Problems of Reinforcement Learning when Applying in Real-Time Power Network Dispatching and Control

Distributed Deep Reinforcement Learning-based Approach for Fast Preventive Control Considering Transient Stability Constraints

An Intelligent Control Strategy for buck DC-DC Converter via Deep Reinforcement Learning

A TD3 Algorithm Based Reinforcement Learning Controller for DC-DC Switching Converters

Actor-Critic Reinforcement Learning with Phased Actor

Temporal Prototype-Aware Learning for Active Voltage Control on Power Distribution Networks

A prior knowledge-embedded reinforcement learning method for real-time active power corrective control in complex power systems

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm

Proximal Policy Optimization-Based Reinforcement Learning Approach for DC-DC Boost Converter Control: A Comparative Evaluation Against Traditional Control Techniques

Toward Expedited Impedance Tuning of a Robotic Prosthesis for Personalized Gait Assistance by Reinforcement Learning Control

Towards Expedited Impedance Tuning of a Robotic Prosthesis for Personalized Gait Assistance by Reinforcement Learning Control

The Ladder in Chaos: A Simple and Effective Improvement to General DRL Algorithms by Policy Path Trimming and Boosting

Bridging Transient and Steady-State Performance in Voltage Control: A Reinforcement Learning Approach with Safe Gradient Flow

An Efficient Time Step Control Method in Transient Simulation for DAE System.

Constrained Reinforcement Learning for Predictive Control in Real-Time Stochastic Dynamic Optimal Power Flow