Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Grid Knowledge Transfer Learning Algorithm and Its Application in Carbon-Energy Combined-Flow Optimization

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Power Flow for Grids with Unfixed Topologies by Using Deep Neural Network

Optimal Dispatch for Low-Carbon Economic Integration with Flexible Load in a Virtual Power Plant

Low-carbon optimal learning scheduling of the power system based on carbon capture system and carbon emission flow theory

Data-driven smart grid carbon emission control methods using graph-based power flow computing

Study On Problem-Solving-Oriented Scale-Free Knowledge Grid

A Novel Fully Informed Water Cycle Algorithm for Solving Optimal Power Flow Problems in Electric Grids

Cross-Domain Knowledge Transfer for Sustainable Heterogeneous Industrial Internet-of-Things Networks

Hybrid technique for leveraging unit commitment in smart grids: minimizing operating costs and carbon dioxide emissions

Multi-Agent Cooperation Based Reduced-Dimension Q(λ) Learning for Optimal Carbon-Energy Combined-Flow

Carbon Flow Estimation in Multi-microgrids Considering Data Sharing Mechanisms

Low Carbon Optimization Scheduling of Micro Grid Based on Improved Particle Swarm Optimization Algorithm

Knowledge graph construction and Internet of Things optimisation for power grid data knowledge extraction

Power control of hybrid grid-connected renewable energy system using machine learning

Grid data asset relationship and intelligent classification integrating knowledge graph and Internet of Things

Online Crucial Power Flow Interface and Security Knowledge Automatic Discovery System: a Promising Humanitarian Technology

Joint Optimal Power Flow Routing and Vehicle-to-Grid Scheduling: Theory and Algorithms

Deep reinforcement learning based power system optimal carbon emission flow

Research on a Low-Carbon Optimization Strategy for Regional Power Grids Considering a Dual Demand Response of Electricity and Carbon

Closed-Loop Hierarchical Operation for Optimal Unit Commitment and Dispatch in Microgrids: A Hybrid System Approach