Abstract:With the massive access to distributed energy resources, an increasing number of users have transformed into prosumers with the functions of producing, storing, and consuming electric energy. Peer-to-peer (P2P) energy trading, as a new way to allow direct energy transactions between prosumers, is becoming increasingly widespread. How to determine the trading strategy of prosumers participating in P2P energy trading while the strategy can satisfy multiple optimization objectives simultaneously is a crucial problem to be solved. To this end, this paper introduces the demand response mechanism and applies the dissatisfaction function to represent the electricity consumption of prosumers. The mid-market rate price is adopted to attract more prosumers to participate in P2P energy trading. The P2P energy trading process among multiple prosumers in the community is constructed as a Markov decision process. We design the method of deep reinforcement learning (DRL) to solve the optimal trading policy of prosumers. DRL, by engaging in continual interactions with the environment, autonomously learns the optimal strategies. Additionally, the deep deterministic policy gradient algorithm is well-suited for handling the continuous and intricate decision problems that arise in the P2P energy trading market. Through the judicious construction of a reinforcement learning environment, this paper achieves multi-objective collaborative optimization. Simulation results show that our proposed algorithm and model reduce costs by 16.5%, compared to the transaction between prosumers and grid, and can effectively decrease the dependence of prosumers on the main grid.

2A Reliable Energy Trading Strategy in Intelligent Microgrids Using Deep Reinforcement Learning

A microgrid power trading framework based on blockchain and deep reinforcement learning

Deep Reinforcement Learning and Blockchain for Peer-to-Peer Energy Trading among Microgrids

Reinforcement Learning in Energy Trading Game among Smart Microgrids.

Energy Trading in Smart Grid: A Deep Reinforcement Learning-based Approach

Peer-to-peer energy trading with energy trading consistency in interconnected multi-energy microgrids: A multi-agent deep reinforcement learning approach

Blockchain-Assisted Secure Energy Trading in Electricity Markets: A Tiny Deep Reinforcement Learning-Based Stackelberg Game Approach

AI-Powered Microgrid Networks: Multi-Agent Deep Reinforcement Learning for Optimized Energy Trading in Interconnected Systems

A Deep Reinforcement Learning-Based Bidding Strategy for Participants in a Peer-to-peer Energy Trading Scenario

Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids

Microgrid Trading Game Model Based on Blockchain Technology and Optimized Particle Swarm Algorithm

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

Power Transaction Game Algorithm with Micro Grid Based on Residual Regression Model

Multi-Agent Deep Reinforcement Learning for Blockchain-Based Energy Trading in Decentralized Electric Vehicle Charger-Sharing Networks

Decentralized Peer-to-peer Energy Trading Strategy in Energy Blockchain Environment: A Game-Theoretic Approach

Artificial Intelligence Based Smart Energy Community Management: A Reinforcement Learning Approach

Peer-to-Peer Energy Trading in a Microgrid Based on Iterative Double Auction and Blockchain

Microgrid trading mechanism enhancement for smart contract considering reputation values

Strategic Prosumers Based Peer-to-Peer Energy Market Design for Residential Microgrids.