Abstract:In the future, the large-scale participation of renewable energy in electricity market bidding is an inevitable trend. In order to describe the Nash equilibrium effect and market power between renewable energy and traditional power generators in the tacit competition in the electricity market, a bidding strategy based on deep reinforcement learning is proposed. The strategy is divided into two layers; the inner layer is the electricity market clearing model, and the outer layer is the deep reinforcement learning optimization algorithm. Taking the equilibrium supply function as the clearing model of the electricity market, considering the green certificate trading mechanism and the carbon emission mechanism, and taking the maximization of social welfare as the objective function, the optimal bidding on the best electricity price is solved. Finally, the calculation examples of the 3-node system and the 30-node system show that compared with other algorithms, more stable convergence results can be obtained, the Nash equilibrium in game theory can be reached, social welfare can be maximized, renewable energy has more market power in the market. The market efficiency evaluation index is introduced to analyze the market efficiency of the two case systems. The final result is one of great significance and value to the reasonable electricity price declaration, the optimization of market resources, and the policy orientation of the electricity market with renewable energy.

Reinforcement Learning Model For Optimizing Generation Bidding Strategy With Risk Management

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

Strategic Bidding of the Electricity Producers Based on the Reinforcement Learning

RISK-CONSTRAINED OPTIMAL BIDDING STRATEGIES FOR GENERATION COMPANIES IN ELECTRICITY MARKET ENVIRONMENT

Optimal Bidding Strategy of Generation Companies Based on Heuristic Dynamic Programming

Bidding Strategy for Generation Companies Participating in Generation-Right Trading Market Employing High-Low Matching Mechanism

A Deep Reinforcement Learning Bidding Algorithm on Electricity Market

Towards The Development Of Risk-Constrained Optimal Bidding Strategies For Generation Companies In Electricity Markets

DEVELOPMENT OF OPTIMAL BIDDING STRATEGIES FOR GENERATION COMPANIES WITH RISK MANAGEMENT

Management of Bilateral Contracts for Gencos Considering the Risk in Spot Market

A Reinforcement-learning-based Bidding Strategy for Power Suppliers with Limited Information

Optimization-Based Bidding Strategies For Deregulated Electric Power Markets

A Conceptual Research on Bidding Strategies in Electricity Markets with Step-Wise Bidding Protocol

Bidding Strategy of Two-Layer Optimization Model for Electricity Market Considering Renewable Energy Based on Deep Reinforcement Learning

A CHANCE CONSTRAINED PROGRAMMING BASED APPROACH FOR BUILDING OPTIMAL BIDDING STRATEGIES FOR GENERATION COMPANIES WITH RISK MANAGEMENT

Reinforcement Learning-Based Bi-Level Strategic Bidding Model of Gas-fired Unit in Integrated Electricity and Natural Gas Markets Preventing Market Manipulation

Generation Bidding Strategies For Marginal Price Based Power Market

Modeling the Strategic Bidding of the Producers in Competitive Electricity Markets with the Watkins' Q (lambda) Reinforcement Learning

Optimal Bidding Strategies For Generation Companies In Electricity Markets With Transmission Capacity Constraints Taken Into Account

Bidding Strategic of Virtual Power Plant Based on End-to-End Deep Reinforcement Learning