Abstract:An efficient energy scheduling strategy of a charging station is crucial for stabilizing the electricity market and accommodating the charging demand of electric vehicles (EVs). Most of the existing studies on energy scheduling strategies fail to coordinate the process of energy purchasing and distribution and, thus, cannot balance the energy supply and demand. Besides, the existence of multiple charging stations in a complex scenario makes it difficult to develop a unified schedule strategy for different charging stations. In order to solve these problems, we propose a multiagent reinforcement learning (MARL) method to learn the optimal energy purchasing strategy and an online heuristic dispatching scheme to develop a energy distribution strategy in this article. Unlike the traditional scheduling methods, the two proposed strategies are coordinated with each other in both temporal and spatial dimensions to develop the unified energy scheduling strategy for charging stations. Specifically, the proposed MARL method combines the multiagent deep deterministic policy gradient (MADDPG) principles for learning purchasing strategy and a long short-term memory (LSTM) neural network for predicting the charging demand of EVs. Moreover, a multistep reward function is developed to accelerate the learning process. The proposed method is verified by comprehensive simulation experiments based on real data of the electricity market in Chicago. The experiment results show that the proposed method can achieve better performance than other state-of-the-art energy scheduling methods in the charging market in terms of the economic profits and users' satisfaction ratio.

Day-ahead Scheduling Based on Reinforcement Learning with Hybrid Action Space

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

A Modified Long Short-Term Memory-Deep Deterministic Policy Gradient-Based Scheduling Method for Active Distribution Networks

Optimal Bi-Level Bidding and Dispatching Strategy between Active Distribution Network and Virtual Alliances Using Distributed Robust Multi-Agent Deep Reinforcement Learning

Optimal Scheduling in IoT-Driven Smart Isolated Microgrids Based on Deep Reinforcement Learning

Optimal self-consumption scheduling of highway electric vehicle charging station based on multi-agent deep reinforcement learning

Day-Ahead Optimal Dispatch in Active Distribution Network Based on Deep Reinforcement Learning with Improved Feature Extraction Network

Real-time Energy Management of a Low-Carbon Micro-Grid Based on Deep Reinforcement Learning

Multistep Multiagent Reinforcement Learning for Optimal Energy Schedule Strategy of Charging Stations in Smart Grid.

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

Real-time scheduling of renewable power systems through planning-based reinforcement learning

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Real-Time Scheduling Method Based on Deep Reinforcement Learning for a Hybrid Wind-Solar-Storage Energy Generation System

Optimal control in microgrid using multi-agent reinforcement learning

Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning

Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor

Multi-agent reinforcement learning framework for real-time scheduling of pump and valve in water distribution networks

Real-Time Microgrid Energy Scheduling Using Meta-Reinforcement Learning