Abstract:This paper proposes a novel bi-level optimization model to study the strategic retail pricing and demand bidding problems of an electricity retailer that considers the interactions between demand response and market clearing process. In order to accurately forecast the day-ahead demand bids submitted by the retailer, a novel deep learning framework based on convolutional neural networks and long short-term memory is proposed that can capture both local trends and long-term dependency of the forecasting data. In addition, uncertainties about the retailer’s served demand, rivals’ demand bids, and wind power generation are incorporated using the data-driven uncertainty set constructed from data. We further propose chance-constrained programming that introduces a set of chance constraints to represent the operational risk associated with the market uncertainties. To solve this problem, we first reformulate chance-constrained programming as a tractable second-order conic programming and then convert it into a single-level mathematical program with equilibrium constraints by using its Karush Kuhn Tucker conditions. The scope of the examined case studies is four-fold. First, they evaluate the benefits of the proposed forecasting framework in terms of higher accuracy and expected profit compared to the conventional forecasting methods. Second, they demonstrate how demand flexibility affects the retailer’s strategies and its business cases. Third, they highlight the added value of the proposed bi-level model capturing the market clearing process by comparing its outcomes against the state-of-the-art bi-level model with exogenous market prices. Finally, they analyze the retailer’s strategies and business cases at different confidence levels regarding the imposed chance constraints.

Influence of Discrete and Continuous Action Spaces on Deep Reinforcement Learning-Based Pricing Strategy Optimization for Electricity Retailers

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

Dynamic Pricing on E-commerce Platform with Deep Reinforcement Learning: A Field Experiment

Offline DRL for Price-Based Demand Response: Learning From Suboptimal Data and Beyond

Integrating Evolutionary Game-Theoretical Methods and Deep Reinforcement Learning for Adaptive Strategy Optimization in User-Side Electricity Markets: A Comprehensive Review

Deep Reinforcement Learning Approach for Capacitated Supply Chain optimization under Demand Uncertainty

A Reinforcement Learning-Based Decision System for Electricity Pricing Plan Selection by Smart Grid End Users.

Deep Reinforcement Learning Based Pricing Strategy of Aggregators Considering Renewable Energy

Price-Based Residential Demand Response Management in Smart Grids: A Reinforcement Learning-Based Approach

Deep Reinforcement Learning-Based Trading Strategy for Load Aggregators on Price-Responsive Demand

Dynamic Demand-Aware Power Grid Intelligent Pricing Algorithm Based on Deep Reinforcement Learning

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Dual-Agent Deep Reinforcement Learning for Dynamic Pricing and Replenishment

An Integrated Optimization + Learning Approach to Optimal Dynamic Pricing for the Retailer with Multi-type Customers in Smart Grids

A deep Q-learning approach to optimize ordering and dynamic pricing decisions in the presence of strategic customers

Deep Reinforcement Learning for Joint Bidding and Pricing of Load Serving Entity

An optimal solutions-guided deep reinforcement learning approach for online energy storage control

Strategic retail pricing and demand bidding of retailers in electricity market: A data-driven chance-constrained programming

Dynamic Incentive Pricing on Charging Stations for Real-Time Congestion Management in Distribution Network: An Adaptive Model-Based Safe Deep Reinforcement Learning Method