Abstract:Transportation electrification, involving large-scale integration of electric vehicles (EV) and fast charging stations (FCS), constitutes one of the key enablers toward decarbonization. Coordination of EV charging routes and demand through suitably designed price signals constitutes an imperative step in secure and economic operation of the coupled transportation network (TN) and power distribution network (PDN). In this work, we model the noncooperative pricing game of self-interested FCSs, taking into account the complex interactions between the EV users and the coupled operation of TN and PND. The uncertainties stemming from the EV users' cost elasticity and their travel energy requirements are encapsulated in the modeling of the TN, while the power flows in the PDN are coordinated considering the penetration of renewable energy sources. A modified multiagent proximal policy optimization method is developed to solve the pricing game. It employs an attention mechanism to selectively incorporate agents' representative information for estimating the Q-values. As such, it not only mitigates the nonstationary effect without exploding the input of the centralized critic but also safeguards the business confidentiality of FCSs. Moreover, a sequential updating scheme is used to ensure policy monotonic improvement and a Bayesian inference technique is adopted to enhance the robustness of the pricing strategy. Case studies on a large-scale test CTPN system reveal that the proposed method facilitates sufficient competition among FCSs, which is able to drive down the average charging prices for EV users. It also smooths out the spatial distribution of EV charging demands, which reduces the traffic congestions in the TN while enhancing the wind absorption and cost efficiency of the PDN.

Deep Reinforcement Learning-Based Charging Pricing Strategy for Charging Station Operators and Charging Navigation for EVs

Multiagent Deep Reinforcement Learning for Electric Vehicle Fast Charging Station Pricing Game in Electricity-Transportation Nexus

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Impact of customer portrait information superiority on competitive pricing of EV fast-charging stations

Optimal Location and Pricing of Electric Vehicle Charging Stations Using Machine Learning and Stackelberg Game

Optimal Dynamic Pricing of Fast Charging Stations Considering Bounded Rationality of Users and Market Regulation

A Stochastic Game Approach for PEV Charging Station Operation in Smart Grid

An Improved Charging Navigation Strategy of Electric Vehicles via Optimal Time-of-Use Pricing

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Dynamic Pricing of Electric Vehicle Charging Station Alliances Under Information Asymmetry

Competitive Charging Station Pricing for Plug-in Electric Vehicles

Deep Reinforcement Learning-Based Strategy for Charging Station Participating in Demand Response

Bounded Rational Real‐time Charging Pricing Strategy under the Traffic‐grid Coupling Network

Real-Time Pricing Strategy for EV Charging Station Alliances Based on Mobile Online Information Interaction Framework

Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

A Multi-Period Charging Service Pricing Game for Public Charging Network Operators Considering the Dynamics of Coupled Traffic-Power Systems.

A real-time charging price strategy of distribution network based on comprehensive demand response of EVs and cooperative game

Charging Station Selection Optimization Based on Electric and Traffic Information

Dynamic Pricing and Service Fulfillment of Mobile Charging Systems with Stochastic Demands

Electric vehicle charging navigation strategy in coupled smart grid and transportation network: A hierarchical reinforcement learning approach

Double-Layer Game Based Wireless Charging Scheduling for Electric Vehicles