Abstract:The widespread adoption of distributed energy resources, and the advent of smart grid technologies, have allowed traditionally passive power system users to become actively involved in energy trading. Recognizing the fact that the traditional centralized grid-driven energy markets offer minimal profitability to these users, recent research has shifted focus towards decentralized peer-to-peer (P2P) energy markets. In these markets, users trade energy with each other, with higher benefits than buying or selling to the grid. However, most researches in P2P energy trading largely overlook the user perception in the trading process, assuming constant availability, participation, and full compliance. As a result, these approaches may result in negative attitudes and reduced engagement over time. In this paper, we design an automated P2P energy market that takes user perception into account. We employ prospect theory to model the user perception and formulate an optimization framework to maximize the buyer's perception while matching demand and production. Given the non-linear and non-convex nature of the optimization problem, we propose Differential Evolution-based Algorithm for Trading Energy called DEbATE. Additionally, we introduce a risk-sensitive Q-learning algorithm, named Pricing mechanism with Q-learning and Risk-sensitivity (PQR), which learns the optimal price for sellers considering their perceived utility. Results based on real traces of energy consumption and production, as well as realistic prospect theory functions, show that our approach achieves a 26% higher perceived value for buyers and generates 7% more reward for sellers, compared to a recent state of the art approach.

The Two-Stage Negotiation Mechanism Based on Multi-Agent Using Q-learning in Electricity Bilateral Contract

Multi-agent simulation-based residential electricity pricing schemes design and user selection decision-making

Multi-Market Bidding Strategy of Power Suppliers

Bargaining strategies in bilateral electricity trading based on fuzzy Bayesian learning

Modelling bidding behavior of power suppliers in electricity markets using multi-agent systems, part 1: Model and algorithm

Multi-Agent Learning in Double-side Auctions forPeer-to-peer Energy Trading

THEORETICAL FUNDAMENTAL AND CONCEPTS OF ELECTRICITY MARKET SIMULATION BASED ON AGENTS' BELIEF LEARNGING

Study of power market simulation based on distributed multi-agent system

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

Bidding Modes for Renewable Energy Considering Electricity-Carbon Integrated Market Mechanism Based on Multi-Agent Hybrid Game

A Multi-round Negotiation Model for Bilateral Contracting Considering Spot Price Risks in Electricity Market Environment

Multi-Agent-System-Based Bi-level Bidding Strategy of Microgrid with Game Theory in the Electricity Market

Bidding Strategy of Two-Layer Optimization Model for Electricity Market Considering Renewable Energy Based on Deep Reinforcement Learning

Bidding Strategic of Virtual Power Plant Based on End-to-End Deep Reinforcement Learning

A Deep Reinforcement Learning Bidding Algorithm on Electricity Market

Bidding Strategy Evolution Analysis Based on Multi-Task Inverse Reinforcement Learning

Prospect Theory-inspired Automated P2P Energy Trading with Q-learning-based Dynamic Pricing

A Multiagent Competitive Bidding Strategy in a Pool-Based Electricity Market With Price-Maker Participants of WPPs and EV Aggregators

Automated Negotiation for Peer-to-Peer Electricity Trading in Local Energy Markets

Finding Nash equilibrium based on reinforcement learning for bidding strategy and distributed algorithm for ISO in imperfect electricity market

Multi-Agent Reinforcement Learning With Privacy Preservation for Continuous Double Auction-Based P2P Energy Trading