Abstract:Electric vehicles (EVs) can inhibit the wind power fluctuations in the generalized form of energy storage.However, optimizing the charging process of EVs under wind power fluctuations is difficult because of the uncertainties of wind power output and user demands.A charging control strategy based on deep reinforcement learning (DRL) was proposed in this study to address the influence brought by uncertain environmental factors to the control.This strategy mined the deep relation between perceiving the uncertainties of environmental factors and learning charging laws by virtue of the perceptual and learning abilities of DRL.An immediate reward mechanism that acts upon the environment was constructed from the angle of neural network fitting function.The EV charging control model was expressed as a Markov decision process (MDP) that contain the state, action, and transfer functions and reward and discount factors through temporal discretization.Next, the single-step updating and experience replay mode were combined to construct the DRL algorithm, followed by the comparative convergence experiment with the reinforcement learning (RL) algorithm that expressed the reward function in mathematical form.In the end, the agent obtained through training was used for the verification of the calculated example.Results show that the constructed RL algorithm is converged by 8,500 episodes earlier.The charging control strategy based on DRL meets the charging requirements when the proportion of optimization objectives is 0.5 and 0.9, and users are allowed to change the allowed charging time temporarily.This study demonstrates that the charging control strategy based DRL can optimize the EVs charging process under many uncertain factors.

A Deep Reinforcement Learning Method for Pricing Electric Vehicles with Discrete Charging Levels

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Deep Reinforcement Learning-based Electric Vehicle Charging Optimization with Renewable Generations

Deep Reinforcement Learning for Charging Electric Vehicles with Uncertain Photovoltaic Power

Electric Vehicle Charging Management Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Electric Vehicle Charging/Discharging Control Method Based on Deep Reinforcement Learning for Photovoltaic Energy Storage Stations

Dynamic Incentive Pricing on Charging Stations for Real-Time Congestion Management in Distribution Network: An Adaptive Model-Based Safe Deep Reinforcement Learning Method

CDDPG: A Deep-Reinforcement-Learning-Based Approach for Electric Vehicle Charging Control

A transfer learning method for electric vehicles charging strategy based on deep reinforcement learning

An Optimal Power Bidding Strategy for Electric Vehicles Via PER-Based Reinforcement Learning

Whether to Charge an Electric Vehicle or Not? A Near-Optimal Online Approach

Optimization Strategy of EVA Participating in Peak Shaving Using Deep Reinforcement Learning

Deep Reinforcement Learning Strategy for Electric Vehicle Charging Considering Wind Power Fluctuation

Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

Unlocking the potential of smart EV charging: A user-oriented control system based on Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning Method for EV Charging Station Game

Research on Orderly Charging Method of Electric Vehicles Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Continuous Electric Vehicles Charging Control With Dynamic User Behaviors

Optimal Management for EV Charging Stations: A Win–Win Strategy for Different Stakeholders Using Constrained Deep Q-Learning

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability