Abstract:An efficient energy scheduling strategy of a charging station is crucial for stabilizing the electricity market and accommodating the charging demand of electric vehicles (EVs). Most of the existing studies on energy scheduling strategies fail to coordinate the process of energy purchasing and distribution and, thus, cannot balance the energy supply and demand. Besides, the existence of multiple charging stations in a complex scenario makes it difficult to develop a unified schedule strategy for different charging stations. In order to solve these problems, we propose a multiagent reinforcement learning (MARL) method to learn the optimal energy purchasing strategy and an online heuristic dispatching scheme to develop a energy distribution strategy in this article. Unlike the traditional scheduling methods, the two proposed strategies are coordinated with each other in both temporal and spatial dimensions to develop the unified energy scheduling strategy for charging stations. Specifically, the proposed MARL method combines the multiagent deep deterministic policy gradient (MADDPG) principles for learning purchasing strategy and a long short-term memory (LSTM) neural network for predicting the charging demand of EVs. Moreover, a multistep reward function is developed to accelerate the learning process. The proposed method is verified by comprehensive simulation experiments based on real data of the electricity market in Chicago. The experiment results show that the proposed method can achieve better performance than other state-of-the-art energy scheduling methods in the charging market in terms of the economic profits and users' satisfaction ratio.

Intelligent Energy Management Method of EV Charging Station with Photovoltaic and Energy Storage System Considering EV Charging Scheduling

Electric Vehicle Charging/Discharging Control Method Based on Deep Reinforcement Learning for Photovoltaic Energy Storage Stations

Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

Multi-objective Optimal Scheduling of Charging Stations Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Deep reinforcement learning method for energy management in fast charging station

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

A cooperative EV charging scheduling strategy based on double deep Q-network and Prioritized experience replay

Data-Driven Energy Management of an Electric Vehicle Charging Station Using Deep Reinforcement Learning

Deep Reinforcement Learning for Charging Electric Vehicles with Uncertain Photovoltaic Power

Constrained Large-Scale Real-Time EV Scheduling Based on Recurrent Deep Reinforcement Learning

Power Dispatching Strategy of Electric Vehicle Charging Station Based on Reinforcement Learning and Heuristic Priority

Smart and Resilient EV Charging in SDN-Enhanced Vehicular Edge Computing Networks

Optimal EV Charging Scheduling Considering the Lack of Charging Facilities Based on Deep Reinforcement Learning

Deep dyna reinforcement learning based energy management system for solar operated hybrid electric vehicle using load scheduling technique

A deep reinforcement learning-based charging scheduling approach with augmented Lagrangian for electric vehicles

Deep Reinforcement Learning-Based Strategy for Charging Station Participating in Demand Response

Multistep Multiagent Reinforcement Learning for Optimal Energy Schedule Strategy of Charging Stations in Smart Grid.

Energy management of green charging station integrated with photovoltaics and energy storage system based on electric vehicles classification

Research on Multi-objective Charging Scheduling Strategy for Electric Vehicles: A Deep Reinforcement Learning Approach

Optimal Management for EV Charging Stations: A Win–Win Strategy for Different Stakeholders Using Constrained Deep Q-Learning