Abstract:With the massive access to distributed energy resources, an increasing number of users have transformed into prosumers with the functions of producing, storing, and consuming electric energy. Peer-to-peer (P2P) energy trading, as a new way to allow direct energy transactions between prosumers, is becoming increasingly widespread. How to determine the trading strategy of prosumers participating in P2P energy trading while the strategy can satisfy multiple optimization objectives simultaneously is a crucial problem to be solved. To this end, this paper introduces the demand response mechanism and applies the dissatisfaction function to represent the electricity consumption of prosumers. The mid-market rate price is adopted to attract more prosumers to participate in P2P energy trading. The P2P energy trading process among multiple prosumers in the community is constructed as a Markov decision process. We design the method of deep reinforcement learning (DRL) to solve the optimal trading policy of prosumers. DRL, by engaging in continual interactions with the environment, autonomously learns the optimal strategies. Additionally, the deep deterministic policy gradient algorithm is well-suited for handling the continuous and intricate decision problems that arise in the P2P energy trading market. Through the judicious construction of a reinforcement learning environment, this paper achieves multi-objective collaborative optimization. Simulation results show that our proposed algorithm and model reduce costs by 16.5%, compared to the transaction between prosumers and grid, and can effectively decrease the dependence of prosumers on the main grid.

Multi-Agent Deep Reinforcement Learning for Simulating Centralized Double-Sided Auction Electricity Market

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Multi-Agent Reinforcement Learning for Automated Peer-to-Peer Energy Trading in Double-Side Auction Market

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

Multi-Agent Deep Reinforcement Learning for Blockchain-Based Energy Trading in Decentralized Electric Vehicle Charger-Sharing Networks

Multi-Agent Learning in Double-side Auctions forPeer-to-peer Energy Trading

A Deep Reinforcement Learning Bidding Algorithm on Electricity Market

A Deep Reinforcement Learning-Based Bidding Strategy for Participants in a Peer-to-peer Energy Trading Scenario

A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids

Energy Trading in Smart Grid: A Deep Reinforcement Learning-based Approach

Multi-Agent Reinforcement Learning with Graph Convolutional Neural Networks for optimal Bidding Strategies of Generation Units in Electricity Markets

Deep Multi-Task Multi-Agent Reinforcement Learning Based Joint Bidding and Pricing Strategy of Price-Maker Load Serving Entity

Auction Design through Multi-Agent Learning in Peer-to-Peer Energy Trading

Reinforcement Learning Based Bidding Framework with High-dimensional Bids in Power Markets

A Scalable Privacy-Preserving Multi-Agent Deep Reinforcement Learning Approach for Large-Scale Peer-to-Peer Transactive Energy Trading

Deep Reinforcement Learning for Joint Bidding and Pricing of Load Serving Entity

Deep Reinforcement Learning-Based Trading Strategy for Load Aggregators on Price-Responsive Demand

Multi-Agent Reinforcement Learning With Privacy Preservation for Continuous Double Auction-Based P2P Energy Trading

Temporal-Aware Deep Reinforcement Learning for Energy Storage Bidding in Energy and Contingency Reserve Markets