Abstract:Periodic double auctions (PDA) have applications in many areas such as in e-commerce, intra-day equity markets, and day-ahead energy markets in smart-grids. While the trades accomplished using PDAs are worth trillions of dollars, finding a reliable bidding strategy in such auctions is still a challenge as it requires the consideration of future auctions. A participating buyer in a PDA has to design its bidding strategy by planning for current and future auctions. Many equilibrium-based bidding strategies proposed are complex to use in real-time. In the current exposition, we propose a scale-based bidding strategy for buyers participating in PDA. We first present an equilibrium analysis for single-buyer single-seller multi-unit single-shot k-Double auctions. Specifically, we analyze the situation when a seller and a buyer trade two identical units of quantity in a double auction where both the buyer and the seller deploy a simple, scale-based bidding strategy. The equilibrium analysis becomes intractable as the number of participants increases. To be useful in more complex settings such as wholesale markets in smart-grids, we model equilibrium bidding strategy as a learning problem. We develop a deep deterministic policy gradient (DDPG) based learning strategy, DDPGBBS, for a participating agent in PDAs to suggest an action at any auction instance. DDPGBBS, which empirically follows the obtained theoretical equilibrium, is easily extendable when the number of buyers/sellers increases. We take Power Trading Agent Competition's (PowerTAC) wholesale market PDA as a testbed to evaluate our novel bidding strategy. We benchmark our DDPG based strategy against several baselines and state-of-the-art bidding strategies of the PowerTAC wholesale market PDA and demonstrate the efficacy of DDPGBBS against several benchmarked strategies.

A Two-stage Negotiation Strategy Based on Multi-agent Using Q-learning in Direct Power Purchase with Large Consumers

The Two-Stage Negotiation Mechanism Based on Multi-Agent Using Q-learning in Electricity Bilateral Contract

Multi-agent simulation-based residential electricity pricing schemes design and user selection decision-making

Multi-Market Bidding Strategy of Power Suppliers

Generators＇ Buy Back Strategies Based on Electricity Supply Chain Coordination with Uncertain Demands

Study of power market simulation based on distributed multi-agent system

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

A Deep Reinforcement Learning-Based Bidding Strategy for Participants in a Peer-to-peer Energy Trading Scenario

A Reinforcement-learning-based Bidding Strategy for Power Suppliers with Limited Information

Simulation of Synergistic Trading in Medium- and Long-Term Power and Carbon Markets Based on a Multiagent Model and Reinforcement Learning Algorithm

STUDY ON BARGAINING OF LARGE POWER CONSUMER' S DIRECT BUYING BASED ON GAME THEORY

A Multiagent Competitive Bidding Strategy in a Pool-Based Electricity Market With Price-Maker Participants of WPPs and EV Aggregators

Game-Theoretic Optimization of Bilateral Contract Transaction for Generation Companies and Large Consumers with Incomplete Information

Multi-Agent Deep Reinforcement Learning for Simulating Centralized Double-Sided Auction Electricity Market

Energy Trading in Smart Grid: A Deep Reinforcement Learning-based Approach

Deep Reinforcement Learning for Price-Quantity-Pair Bidding in Electricity Markets

Optimal Bidding Strategy of Generation Companies Based on Heuristic Dynamic Programming

Multi-Agent Reinforcement Learning for Automated Peer-to-Peer Energy Trading in Double-Side Auction Market

Multi-unit Double Auctions: Equilibrium Analysis and Bidding Strategy using DDPG in Smart-grids

Multi-Agent Learning in Double-side Auctions forPeer-to-peer Energy Trading

Study on Bidding Strategy of Comprehensive Power Retailer Under Multiple User-Price Mechanisms