Abstract:Electric vehicles (EVs) can inhibit the wind power fluctuations in the generalized form of energy storage.However, optimizing the charging process of EVs under wind power fluctuations is difficult because of the uncertainties of wind power output and user demands.A charging control strategy based on deep reinforcement learning (DRL) was proposed in this study to address the influence brought by uncertain environmental factors to the control.This strategy mined the deep relation between perceiving the uncertainties of environmental factors and learning charging laws by virtue of the perceptual and learning abilities of DRL.An immediate reward mechanism that acts upon the environment was constructed from the angle of neural network fitting function.The EV charging control model was expressed as a Markov decision process (MDP) that contain the state, action, and transfer functions and reward and discount factors through temporal discretization.Next, the single-step updating and experience replay mode were combined to construct the DRL algorithm, followed by the comparative convergence experiment with the reinforcement learning (RL) algorithm that expressed the reward function in mathematical form.In the end, the agent obtained through training was used for the verification of the calculated example.Results show that the constructed RL algorithm is converged by 8,500 episodes earlier.The charging control strategy based on DRL meets the charging requirements when the proportion of optimization objectives is 0.5 and 0.9, and users are allowed to change the allowed charging time temporarily.This study demonstrates that the charging control strategy based DRL can optimize the EVs charging process under many uncertain factors.

Transfer Deep Reinforcement Learning-based Large-scale V2G Continuous Charging Coordination with Renewable Energy Sources

Deep Reinforcement Learning-Based Battery Conditioning Hierarchical V2G Coordination for Multi-Stakeholder Benefits

Online EVs Vehicle-to-Grid Scheduling Coordinated with Multi-Energy Microgrids: A Deep Reinforcement Learning-Based Approach

Constrained Large-Scale Real-Time EV Scheduling Based on Recurrent Deep Reinforcement Learning

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

SOC-Boundary and Battery Aging Aware Hierarchical Coordination of Multiple EV Aggregates Among Multi-stakeholders with Multi-Agent Constrained Deep Reinforcement Learning

Optimal vehicle-to-grid control for supplementary frequency regulation using deep reinforcement learning

A Deep RL-based Algorithm for Coordinated Charging of Electric Vehicles

Multi-objective Optimal Scheduling of Charging Stations Based on Deep Reinforcement Learning

Constrained Double Deep Q-learning Network for EVs Charging Scheduling with Renewable Energy

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

A Constrained DRL-based Bi-Level Coordinated Method for Large-Scale EVs Charging

A deep reinforcement learning-based charging scheduling approach with augmented Lagrangian for electric vehicles

A transfer learning method for electric vehicles charging strategy based on deep reinforcement learning

A cooperative EV charging scheduling strategy based on double deep Q-network and Prioritized experience replay

A Deep Reinforcement Learning-Based Charging Scheduling Approach with Augmented Lagrangian for Electric Vehicle

Deep Reinforcement Learning Strategy for Electric Vehicle Charging Considering Wind Power Fluctuation

Mobility-Aware Charging Scheduling for Shared On-Demand Electric Vehicle Fleet Using Deep Reinforcement Learning

Virtual power plant containing electric vehicles scheduling strategies based on deep reinforcement learning

Deep-Reinforcement-Learning-Based Vehicle-to-Grid Operation Strategies for Managing Solar Power Generation Forecast Errors