Abstract:The rapid development of electric vehicle (EV) technology and the consequent charging demand have brought challenges to the stable operation of distribution networks (DNs). The problem of the collaborative optimization of the charging scheduling of EVs and voltage control of the DN is intractable because the uncertainties of both EVs and the DN need to be considered. In this paper, we propose a deep reinforcement learning (DRL) approach to coordinate EV charging scheduling and distribution network voltage control. The DRL-based strategy contains two layers, the upper layer aims to reduce the operating costs of power generation of distributed generators and power consumption of EVs, and the lower layer controls the Volt/Var devices to maintain the voltage stability of the distribution network. We model the coordinate EV charging scheduling and voltage control problem in the distribution network as a Markov decision process (MDP). The model considers uncertainties of charging process caused by the charging behavior of EV users, as well as the uncertainty of uncontrollable load, system dynamic electricity price and renewable energy generation. Since the model has a dynamic state space and mixed action outputs, a framework of deep deterministic policy gradient (DDPG) is adopted to train the two-layer agent and the policy network is designed to output discrete and continuous control actions. Simulation and numerical results on the IEEE-33 bus test system demonstrate the effectiveness of the proposed method in collaborative EV charging scheduling and distribution network voltage stabilization.

Two-timescale online coordinated schedule of active distribution network considering dynamic network reconfiguration via bi-level safe deep reinforcement learning

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

Three-Stage Inverter-Based Peak Shaving and Volt-VAR Control in Active Distribution Networks Using Online Safe Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Two-Stage Multi-Mode Voltage Control for Distribution Networks: A Deep Reinforcement Learning Approach Based on Multiple Intelligences

Two-Stage Deep Reinforcement Learning for Inverter-Based Volt-VAR Control in Active Distribution Networks

Reinforcement Learning-Based Net Load Volatility Control of Active Distribution Power Networks

Combining multi-step reconfiguration with many-objective reduction as iterative bi-level scheduling for stochastic distribution network

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

Real-time autonomous dynamic reconfiguration based on deep learning algorithm for distribution network

Active and Reactive Power Coordinated Control of Active Distribution Networks Based on Prioritized Reinforcement Learning

Deep Reinforcement Leaming for Short-term Voltage Control by Dynamic Load Shedding in China Southem Power Grid

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Safe Imitation Learning-based Optimal Energy Storage Systems Dispatch in Distribution Networks

Power balance control of RES integrated power system by deep reinforcement learning with optimized utilization rate of renewable energy