Abstract:Extreme events are featured by high impact and low probability, which can cause severe damage to power systems. There has been much research focused on resilience-driven operational problems incorporating mobile energy storage systems (MESSs) routing and scheduling due to its mobility and flexibility. However, existing literature focuses on model-based optimization approaches to implement the routing process of MESSs, which can be time consuming and raise privacy issues since the requirement for global information of both power and transportation networks. Furthermore, a real-time automatic control scheme of MESSs has become a challenging task due to the system high variability. As such, this paper develops a model-free real-time multi-agent deep reinforcement learning approach featuring parameterized double deep Q-networks to reformulate the coordination effect of MESSs routing and scheduling process as a Partially Observable Markov Game, which is capable of capturing a hybrid policy including both discrete and continuous actions. A coupled transportation network and linearized AC-OPF algorithm are realized as the environment, while the internal uncertainties associated with renewable energy sources, load profiles, line outages, and traffic volumes are incorporated into the proposed data-driven approach through learning procedure. Extensive case studies including both 6-bus and 33-bus power networks are developed to evaluate the effectiveness of the proposed approach. Specifically, a detailed comparison between different multi-agent reinforcement learning and model-based optimization approaches is conducted to present the superior performance of the proposed approach.

Multi-agent Deep Reinforcement Learning for Microgrid Energy Scheduling

Multi-Agent Reinforcement Learning Based Scheduling for Distributed PV-ESS Considering Incomplete Data Acquisition

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning

Real-time Energy Management of a Low-Carbon Micro-Grid Based on Deep Reinforcement Learning

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

Distributed quantum multiagent deep meta reinforcement learning for area autonomy energy management of a multiarea microgrid

Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Multi-Agent Reinforcement Learning Approach for Residential Microgrid Energy Scheduling

Multi-agent deep reinforcement learning-based optimal energy management for grid-connected multiple energy carrier microgrids

Multi-agent deep reinforcement learning based distributed control architecture for interconnected multi-energy microgrid energy management and optimization

Multiagent deep meta reinforcement learning for sea computing-based energy management of interconnected grids considering renewable energy sources in sustainable cities

Dueling Double Q-learning Based Real-time Energy Dispatch in Grid-connected Microgrids

Joint Energy and Carbon Trading for Multi-Microgrid System Based on Multi-Agent Deep Reinforcement Learning

A Multi-Agent Deep-Reinforcement-Learning-Based Strategy for Safe Distributed Energy Resource Scheduling in Energy Hubs

Multi-agent Deep Reinforcement Learning for Resilience-Driven Routing and Scheduling of Mobile Energy Storage Systems

Peer-to-peer energy trading with energy trading consistency in interconnected multi-energy microgrids: A multi-agent deep reinforcement learning approach