Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Decarbonising the GB Power System Via Numerous Electric Vehicle Coordination

Scenario analysis, management, and optimization of a new Vehicle-to-Micro-Grid (V2G) network based on off-grid renewable building energy systems

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Case Studies of a Distributed Building Energy System Incorporating with EVs Considering Effects of Random Charging Behaviors and Time-of-use Pricing in Electricity

Low Carbon Electric Vehicle Charging Coordination in Coupled Transportation and Power Networks

V2G Carbon Accounting and Revenue Allocation: Balancing EV Contributions in Distribution Systems

Joint Energy-Computation Management for Electric Vehicles under Coordination of Power Distribution Networks and Computing Power Networks

Whole-system Potential and Benefit of Energy Storage by Vehicle-to-grid (V2G) under Carbon Neutrality Target in China

Planning integrated energy systems coupling V2G as a flexible storage

Large-Scale EV Integrated Multi-energy System Optimal Dispatch and Carbon Flow Analysis

Distributed Vehicle-to-Grid (V2G) Coordination: an Efficient and Cost-Effective Framework Based on Multilevel Game Theory

Coupled dispatching of regional integrated energy system under an electric-traffic environment considering user equilibrium theory

Coordinated Electric Vehicle Charging Control with Aggregator Power Trading and Indirect Load Control

Economic and Environmental Benefits of Vehicle-to-Grid in the Power System: A National Study of China’s 2030 and 2060 Dual-Carbon Goal

A Hierarchical Framework for Vehicle-to-Grid (V2G) Distributed Control Combining Peer-to-peer Blockchain with Systemic Scheduling

Decentralized V2G/G2V Scheduling of EV Charging Stations by Considering the Conversion Efficiency of Bidirectional Chargers

A multi-level vehicle-to-grid optimal scheduling approach with EV economic dispatching model

Research on Scheduling of Hybrid AC/DC Distribution Network Considering V2G

Data-Driven Carbon Footprint Management of Electric Vehicles and Emission Abatement in Electricity Networks

A Distributed Week-Ahead Scheduling Method for the Charging / Discharging of Plug-in Electric Vehicles Integrated into the Grid

Potential Benefits of Vehicle-to-grid (V2G) to Decarbonization Pathways toward Carbon Neutrality