Abstract:With the growing popularity of charging pile infrastructure and the development of smart electronic devices and 5G communication technologies, the electric vehicle aggregator (EVA) as a bidding entity can aggregate numerous electric vehicle (EV) resources to participate in the electricity market. Moreover, as the number of grid-connected EVs increases, EVA will have an impact on the nodal marginal prices of electricity market clearing. Aiming at the bidding and offering problem of EVA participation in the day-ahead and intra-day electricity markets, based on the Stackelberg game theory, this paper establishes a bilevel optimization model for EVA participation in the two-stage electricity market as a price-maker. In the proposed bilevel model, the upper-level and lower-level models are constructed as an operational problem for EVA and a market-clearing problem for independent system operator (ISO), respectively. In the day-ahead stage, EVA is optimized to maximize its own expected benefits, and ISO aims to improve the social benefits. In the intra-day stage, EVA is optimized to maximize its self-interest, and the ISO aims to make it possible to minimize the cost of expenditures to maintain the system's supply–demand balance. Karush–Kuhn–Tucker (KKT) conditions and dual theory are used to transform the nonlinear bilevel programming model into a mixed-integer single-level linear programming model. In order to verify the validity of the proposed bilevel model as well as to comparatively analyze the impact of EVA's participation in the electricity market on the market clearing results. Two scenarios are set up where EVA is seen as the price-taker in Scenario 1 and EVA is seen as the price-maker in Scenario 2. ISO's revenue under Scenario 2 increased by USD 2262.66 compared to Scenario 1. In addition, the EVA acts as an energy consumer in Scenario 1 with a charging cost of USD 26,432.95, whereas in Scenario 2, the EVA can profit by participating in the electricity market with a revenue of USD 26,432.95, at which point the EVA acts like a virtual power plant. The simulation examples verify that the proposed bilevel optimization model can improve the benefits of ISO and EVA at the same time, achieving mutual benefits for both parties. In addition, the simulation analyzes the impact of abandonment penalty price on ISO and EVA intra-day revenues. Comparing the scenarios where the abandonment penalty price is 0 with USD 10/MW, the ISO's revenue in the intra-day market decreases by USD 197.5. Correspondingly, EVA's reserve capacity is dispatched to consume wind power in the intra-day market, and its revenue increases by USD 197.5. The proposed two-stage bilevel optimization model can provide a reference for EVA to develop scheduling strategies in the day-ahead and intra-day electricity markets.

Bilevel Model for Electricity Market Mechanism Optimisation via Quantum Computing Enhanced Reinforcement Learning

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Evaluating Uncertainties in Electricity Markets via Machine Learning and Quantum Computing

Modeling the Strategic Bidding of the Producers in Competitive Electricity Markets with the Watkins' Q (lambda) Reinforcement Learning

Quantum Reinforcement Learning-Based Two-Stage Unit Commitment Framework for Enhanced Power Systems Robustness

Deep reinforcement learning-based optimal bidding strategy for real-time multi-participant electricity market with short-term load

A Deep Reinforcement Learning Bidding Algorithm on Electricity Market

Proximal Policy Optimization Based Reinforcement Learning for Joint Bidding in Energy and Frequency Regulation Markets

Long-term electricity market agent based model validation using genetic algorithm based optimization

Bi-Level Strategic Bidding Model of Gas-fired Units in Interdependent Electricity and Natural Gas Markets

Strategic Bidding of the Electricity Producers Based on the Reinforcement Learning

Bidding Behaviors of GENCOs under Bounded Rationality with Renewable Energy

Machine Learning-Driven Virtual Bidding with Electricity Market Efficiency Analysis

Reinforcement Learning-Based Bi-Level Strategic Bidding Model of Gas-fired Unit in Integrated Electricity and Natural Gas Markets Preventing Market Manipulation

An Optimized Decision Model for Electric Vehicle Aggregator Participation in the Electricity Market Based on the Stackelberg Game

Reinforcement Learning Model For Optimizing Generation Bidding Strategy With Risk Management

Self‐adaptive Hybrid Algorithm Based Bi‐level Approach for Virtual Power Plant Bidding in Multiple Retail Markets

Integrating Evolutionary Game-Theoretical Methods and Deep Reinforcement Learning for Adaptive Strategy Optimization in User-Side Electricity Markets: A Comprehensive Review

Optimal Bidding Model for Joint Electricity and Carbon Market

Revenue Adequate Bidding Strategies in Competitive Electricity Markets

Bidding Strategy of Two-Layer Optimization Model for Electricity Market Considering Renewable Energy Based on Deep Reinforcement Learning