Abstract:This paper discusses a tri-layer non-cooperative energy trading approach among multiple grid-tied multi-energy microgrids (MEMGs) in the restructured integrated energy market. The heterogeneous uncertainties from renewable energy, market prices, and electric energy loads are also considered via the risk-averse stochastic programming (SP) approach. First, comprehensive operation models of individual MEMGs are presented with the consideration of practical electric energy and thermal network flows as well as battery degradation. Second, to guarantee fair multi-energy trading among MEMGs and deal with adverse effects from all uncertainty sources, a tri-layer Cournot Nash game-based energy bidding method is developed and solved by the SP approach. In the first layer, i.e., day-ahead multi-energy market, optimal energy bids, dispatches of energy storage assets, and thermal flows against uncertainty scenarios are acquired in a risk-averse manner; In the second layer, i.e., intra-day multi-energy market, optimal intra-day energy bids and dispatches of all resources against uncertainty realizations are sequentially calculated; In the third layer, i.e., the real-time multi-energy market, transactions between each MEMG and the wholesale multi-energy market are finalized. Third, for protecting the privacy of individual MEMGs and alleviating the computation burdens, the distributed alternating search procedure is employed to compute the Nash equilibriums in the day-ahead and intra-day markets. In the end, numerical case studies are conducted to verify the effectiveness of our method. From the simulation results, it can be inferred that compared with the traditional cooperative, deterministic and risk-natural methods in the literature, our proposed method is more practical and economical for real-world applications since it comprehensively considers the market competition, uncertainty handling, and energy trading risk.

Price-Matching-Based Regional Energy Market with Hierarchical Reinforcement Learning Algorithm

A Hierarchical Deep Reinforcement Learning-Based Community Energy Trading Scheme for a Neighborhood of Smart Households

Bi-level stochastic real-time pricing model in multi-energy generation system: A reinforcement learning approach

Multi-Agent Reinforcement Learning With Privacy Preservation for Continuous Double Auction-Based P2P Energy Trading

Peer-to-Peer Energy Trading of Solar and Energy Storage: A Networked Multiagent Reinforcement Learning Approach

Peer-to-Peer Trading for Energy-Saving Based on Reinforcement Learning

Peer-to-peer energy trading optimization in energy communities using multi-agent deep reinforcement learning

Mean-Field Multi-Agent Reinforcement Learning for Peer-to-Peer Multi-Energy Trading

Peer-to-peer energy trading with energy trading consistency in interconnected multi-energy microgrids: A multi-agent deep reinforcement learning approach

Dynamic Matching Markets in Power Grid: Concepts and Solution using Deep Reinforcement Learning

A Scalable Privacy-Preserving Multi-Agent Deep Reinforcement Learning Approach for Large-Scale Peer-to-Peer Transactive Energy Trading

Multi-Agent Deep Reinforcement Learning for Blockchain-Based Energy Trading in Decentralized Electric Vehicle Charger-Sharing Networks

Indirect Multi-energy Transactions of Energy Internet with Deep Reinforcement Learning Approach

A distributed real-time pricing strategy based on reinforcement learning approach for smart grid

Distributed tri-layer risk-averse stochastic game approach for energy trading among multi-energy microgrids

Reinforcement Learning-Based Energy Trading and Management of Regional Interconnected Microgrids

Decentralized Coordination of Distributed Energy Resources through Local Energy Markets and Deep Reinforcement Learning

Joint Energy and Carbon Trading for Multi-Microgrid System Based on Multi-Agent Deep Reinforcement Learning

A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids

Multi-Agent Reinforcement Learning for Automated Peer-to-Peer Energy Trading in Double-Side Auction Market

Deep Reinforcement Learning Based Pricing Strategy of Aggregators Considering Renewable Energy