Abstract:Multi-building multi-energy virtual power plants (MB-ME-VPPs) show great promise for the aggregation and coordination of distributed flexible resources across multiple integrated energy buildings to participate in electricity markets. However, a significant challenge arises when managing the energy of MB-ME-VPPs, especially since buildings can dynamically join or depart during the aggregation phase. Traditional model- based optimization methods face difficulties in obtaining accurate mathematical models of individual buildings, and may also raise privacy concerns. In contrast, model-free multi-agent reinforcement learning (MARL) methods offer a promising alternative by allowing agents to learn their control policies through interactions with their environments. Nevertheless, conventional MARL methods are normally applied in static multi- agent environments, where the number and identity of agents remain fixed and predetermined. Consequently, these conventional MARL methods lack the ability to adapt to the dynamic behaviors of agents joining or leaving the environment. To this end, this paper proposes a novel approach named MAT-Adapt, embedding the multi-agent transformer with a parallel adapter module, to address the dynamic participation issue in MB-ME-VPP energy management. Firstly, it formulates the coordination of building agents as a sequential modeling process and leverages the representational capabilities of the attention mechanism from the multi- agent transformer technique. Secondly, it introduces a parallel adapter module called AdaptMLP to enhance adaptability during the dynamic participation phase, efficiently reducing the need for extensive fine-tuning of model parameters. Simulations on the IEEE 33-bus distributional electricity market with 3 to 9 multi- energy buildings show the superior performance of our proposed MAT-Adapt method in facilitating efficient coordination of dynamically participating buildings within the context of the MB-ME-VPP. In comparison to the conventional MADDPG and MAPPO methods training from scratch, the proposed MAT-Adapt method demonstrates its superior adaptability, achieving 0.75-0.91 normalized rewards in new state conditions within 5% of training episodes, while MADDPG and MAPPO can only reach 0.11-0.43 within the same timeframe. Furthermore, the proposed MAT-Adapt method exhibits its strong generalization performance by evaluating the dynamic participation of various building types and regions.

Virtual Power Plant Adjustable Resource Aggregation Adjustment Optimization Strategy Based on Multi-agent Game

Adaptive Multi-Agent Reinforcement Learning for Flexible Resource Management in a Virtual Power Plant with Dynamic Participating Multi-Energy Buildings

Multi-agent Cooperative Optimization Strategy of a Virtual Power Plant Based on Game Theory

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Optimal aggregation of a virtual power plant based on a distribution-level market with the participation of bounded rational agents

Double Layer Dynamic Game Bidding Mechanism Based on Multi-Agent Technology for Virtual Power Plant and Internal Distributed Energy Resource

Economic Dispatch Strategy for Virtual Power Plants Based on Distributed Multi-Agent Algorithms

Virtual power plant containing electric vehicles scheduling strategies based on deep reinforcement learning

Automatic Generation Control Strategy with Aggregated Generation Units Based on Mesh Adaptive Multi-Objective Optimization Algorithm

Multi-agent Evaluation for Energy Management by Practically Scaling Α-Rank

Optimal Scheduling of Virtual Power Plant Based on Stackelberg Game in the Context of “Electricity-Carbon-Green” Market

Joint bidding strategy of multi‐virtual power plant operators

Transaction strategy of virtual power plants and multi-energy systems with multi-agent Stackelberg game based on integrated energy-carbon pricing

Aggregating Additional Flexibility from Quick-Start Devices for Multi-Energy Virtual Power Plants

Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Optimal Scheduling of Multiple Entities in Virtual Power Plant Based on the Master-Slave Game

A Multi-Agent Optimal Bidding Strategy in Multi-Operator VPPs Based on SGHSA

Flexible Resource Dynamic Aggregation Regulation Method of Virtual Power Plant to Ensure More Renewable Energy Generation

Optimal dispatch and bidding strategy of a virtual power plant based on a Stackelberg game