Abstract:With the massive access to distributed energy resources, an increasing number of users have transformed into prosumers with the functions of producing, storing, and consuming electric energy. Peer-to-peer (P2P) energy trading, as a new way to allow direct energy transactions between prosumers, is becoming increasingly widespread. How to determine the trading strategy of prosumers participating in P2P energy trading while the strategy can satisfy multiple optimization objectives simultaneously is a crucial problem to be solved. To this end, this paper introduces the demand response mechanism and applies the dissatisfaction function to represent the electricity consumption of prosumers. The mid-market rate price is adopted to attract more prosumers to participate in P2P energy trading. The P2P energy trading process among multiple prosumers in the community is constructed as a Markov decision process. We design the method of deep reinforcement learning (DRL) to solve the optimal trading policy of prosumers. DRL, by engaging in continual interactions with the environment, autonomously learns the optimal strategies. Additionally, the deep deterministic policy gradient algorithm is well-suited for handling the continuous and intricate decision problems that arise in the P2P energy trading market. Through the judicious construction of a reinforcement learning environment, this paper achieves multi-objective collaborative optimization. Simulation results show that our proposed algorithm and model reduce costs by 16.5%, compared to the transaction between prosumers and grid, and can effectively decrease the dependence of prosumers on the main grid.

An Optimal Power Bidding Strategy for Electric Vehicles Via PER-Based Reinforcement Learning

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

EV charging bidding by multi-DQN reinforcement learning in electricity auction market

A Deep Reinforcement Learning Method for Pricing Electric Vehicles with Discrete Charging Levels

Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

Power Dispatching Strategy of Electric Vehicle Charging Station Based on Reinforcement Learning and Heuristic Priority

Optimization Strategy of EVA Participating in Peak Shaving Using Deep Reinforcement Learning

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

Personalized Dynamic Pricing Policy for Electric Vehicles: Reinforcement learning approach

Development of Optimal Bidding Strategy for an Electric Vehicle Aggregator in a Real-Time Electricity Market

Optimal Scheduling for Charging and Discharging of Electric Vehicles Based on Deep Reinforcement Learning

Multi-objective Optimal Scheduling of Charging Stations Based on Deep Reinforcement Learning

Deep Reinforcement Learning-based Electric Vehicle Charging Optimization with Renewable Generations

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

Research on Multi-objective Charging Scheduling Strategy for Electric Vehicles: A Deep Reinforcement Learning Approach

Research on Orderly Charging Method of Electric Vehicles Based on Deep Reinforcement Learning

Mobility-Aware Charging Scheduling for Shared On-Demand Electric Vehicle Fleet Using Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Blockchain-Based Energy Trading in Decentralized Electric Vehicle Charger-Sharing Networks

A Deep Reinforcement Learning-Based Bidding Strategy for Participants in a Peer-to-peer Energy Trading Scenario

A cooperative EV charging scheduling strategy based on double deep Q-network and Prioritized experience replay