Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Price-based demand response in the coupled power and transportation network via EV charging station

Integrated Pricing Strategy for Coordinating Load Levels in Coupled Power and Transportation Networks

Dynamic Coordinated Pricing for Coupled Power-Transportation Network

Aggregate Demand Response Strategies for Smart Communities with Battery-Charging/switching Electric Vehicles

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Enhanced Coordinated Operations of Electric Power and Transportation Networks Via EV Charging Services

Electric Vehicles Assisted Multi-Household Cooperative Demand Response Strategy

Deep Reinforcement Learning-Based Strategy for Charging Station Participating in Demand Response

Learning and Optimization for Price-based Demand Response of Electric Vehicle Charging

A real-time charging price strategy of distribution network based on comprehensive demand response of EVs and cooperative game

Electrical Vehicle Assisted Demand Side Energy Management

Coordinated dispatch of electric vehicles and wind power considering time-of-use pricing

Strategic Pricing of Electric Vehicle Charging Service Providers in Coupled Power-Transportation Networks

Cooperative Control of EVs Participating in Demand Response Based on Improved Discrete-Time Leader-Following Consensus

Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network

A Capacity-Based Regulation Method for Coordinating Electric Vehicle Charging Flows in Coupled Distribution and Transportation Networks

Day-Ahead Economic Dispatch Strategy for Distribution Network Considering Total Cost Price-Based Demand Response

Comprehensive Modeling of Electric Vehicles in California Demand Response Markets

Multiagent Deep Reinforcement Learning for Electric Vehicle Fast Charging Station Pricing Game in Electricity-Transportation Nexus

Market-based Demand Response via Residential Plug-in Electric Vehicles in Smart Grids

Multi-Agent Deep Reinforcement Learning Method for EV Charging Station Game