Abstract:With the participation of renewable energy sources (RESs) in the electricity market, the inherent uncertainty brings new challenges for strategic bidding and market clearing in the electricity market. In this paper, the market structure is formulated as a non-cooperative game among power suppliers, consumers, and the market operator. A reinforcement-probability Bayesian approach is proposed to obtain the optimal bidding strategy of RESs and achieve maximal social welfare at the market clearing, considering uncertain cost types of RESs and incomplete market information. First, a reinforcement-probability model is presented to obtain the optimal agent-type-strategy combination considering the uncertainty of cost type selection. A agent-type-probability algorithm is proposed for the model to update the mean of probability density function of cost types according to the expected profit. Second, an incremental-cost-based distributed algorithm is proposed to solve the market clearing problem, which accelerates the convergence rate without violating the system constraints via feedback from the scheduled power. Finally, a Bayesian probability model is proposed for RESs to learn the hidden information of the market and transform the incomplete information electricity market into a complete one. A Bayesian Nash equilibrium is reached in the model. To coordinate the information among market participants, the output of the Bayesian probability model is calculated by the Hysteretic Q-learning algorithm and used as the reward to update the agent-type-probability in the reinforcement-probability model. An illustrative example is presented to demonstrate the effectiveness of the proposed approach, which shows that the proposed approach has a better convergence performance and has a 2–6 times faster learning speed compared with the policy gradient and deep Q-network.

Reliability-Aware Probabilistic Reserve Procurement

Reliability-aware Probabilistic Reserve Procurement under Decision-dependent Uncertainty

A Reliability-Based Reserve Criterion For Market Settlement With Interruptible Loads

A peer‐to‐peer joint energy and reserve market considering renewable generation uncertainty: A generalized Nash equilibrium approach

Chance-Constrained Peer-to-Peer Joint Energy and Reserve Market Considering Renewable Generation Uncertainty.

Procurement and pricing of operating reserves based on the capacity-reliability correlation analysis

A reinforcement-probability Bayesian approach for strategic bidding and market clearing for renewable energy sources with uncertainty

Reliability-based Long Term Hydro/thermal Reserve Allocation of Power Systems with High Wind Power Penetration

A Scenario-oriented Approach to Energy-Reserve Joint Procurement and Pricing

Operating Reliability Evaluation of Power Systems Considering Flexible Reserve Provider in Demand Side

Reliability Power Pricing for Electricity Market Operation Environment

Integrating Renewable Energy Sources as Reserve Providers: Modeling, Pricing, and Properties

Development of Energy and Reserve Pre-Dispatch and Re-Dispatch Models for Real-Time Price Risk and Reliability Assessment

Risk-Aware Dimensioning and Procurement of Contingency Reserve

Managing Wind Power Uncertainty Through Strategic Reserve Purchasing

Procurement of Spinning Reserve Capacity in aHydropower Dominated System Through MixedStochastic-Robust Optimization

Robust Offering Strategy for A Wind Power Producer under Uncertainties

Spinning Reserve Requirement Optimization Considering Integration of Plug-In Electric Vehicles.

Operating Reserve Quantification Using Prediction Intervals of Wind Power: an Integrated Probabilistic Forecasting and Decision Methodology

Dynamic Reserve and Transmission Capacity Allocation in Wind-Dominated Power Systems

Dynamic Reserves for Managing Wind Power