Abstract:The rapid development of electric vehicle (EV) technology and the consequent charging demand have brought challenges to the stable operation of distribution networks (DNs). The problem of the collaborative optimization of the charging scheduling of EVs and voltage control of the DN is intractable because the uncertainties of both EVs and the DN need to be considered. In this paper, we propose a deep reinforcement learning (DRL) approach to coordinate EV charging scheduling and distribution network voltage control. The DRL-based strategy contains two layers, the upper layer aims to reduce the operating costs of power generation of distributed generators and power consumption of EVs, and the lower layer controls the Volt/Var devices to maintain the voltage stability of the distribution network. We model the coordinate EV charging scheduling and voltage control problem in the distribution network as a Markov decision process (MDP). The model considers uncertainties of charging process caused by the charging behavior of EV users, as well as the uncertainty of uncontrollable load, system dynamic electricity price and renewable energy generation. Since the model has a dynamic state space and mixed action outputs, a framework of deep deterministic policy gradient (DDPG) is adopted to train the two-layer agent and the policy network is designed to output discrete and continuous control actions. Simulation and numerical results on the IEEE-33 bus test system demonstrate the effectiveness of the proposed method in collaborative EV charging scheduling and distribution network voltage stabilization.

A Date-Driven Voltage Control Strategy for Distribution Network Using Deep Reinforcement Learning

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Data-Driven Distribution System Coordinated PV Inverter Control Using Deep Reinforcement Learning

Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning

A MATD3 -based Voltage Control Strategy for Distribution Networks Considering Active and Reactive Power Adjustment Costs

Data-Driven Multi-Agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

Online Voltage Control Strategy: Multi-Mode Based Data-Driven Approach for Active Distribution Networks

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

Optimal Real-Time Voltage/Var Control for Distribution Network: Droop-control Based Multi-Agent Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Realistic Distribution System Voltage Control Using PV Inverters

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

Two-Stage Multi-Mode Voltage Control for Distribution Networks: A Deep Reinforcement Learning Approach Based on Multiple Intelligences

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Demand Management

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information

Coordinated voltage regulation of high renewable-penetrated distribution networks: An evolutionary curriculum-based deep reinforcement learning approach

Deep Reinforcement Learning Based Coordinated Voltage Control in Smart Distribution Network