Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Voltage Constrained Heavy Duty Vehicle Electrification: Formulation and Case Study

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

The impact of heavy-duty vehicle electrification on large power grids: A synthetic Texas case study

Distribution Network Electric Vehicle Hosting Capacity Maximization: A Chargeable Region Optimization Model

Mitigation of Distribution Transformer Overloading with Rolling-Horizon Optimization of Vehicle-to-Grid Resource

Optimal Day-Ahead Transport and Charge Scheduling of Autonomous Electric Vehicle Fleet using Local Renewable Energy Generation

A Novel Mathematical Model for Infrastructure Planning of Dynamic Wireless Power Transfer Systems for Electric Vehicles

Dynamic Flow Equilibrium of Transportation and Power Distribution Networks Considering Flexible Traveling Choices and Voltage Quality Improvement

Modeling and Solving Method for Supporting ‘Vehicle-to-anything’ EV Charging Mode

Modeling and Simulation of the EV Charging in a Residential Distribution Power Grid

Impact of Electric Vehicle Routing with Stochastic Demand on Grid Operation

Modeling the impact of vehicle-to-grid discharge technology on transport and power systems

PEVs modeling and impacts mitigation in distribution networks

Distributed Control of Charging for Electric Vehicle Fleets under Dynamic Transformer Ratings

Assessment of the Impact of Electric Vehicles on the Design and Effectiveness of Electric Distribution Grid with Distributed Generation

Electric Vehicle Routing and Charging/Discharging under Time-Variant Electricity Prices

Modeling Charging Demands of Various Types of Electric Vehicles in an Actual Distribution System

Increasing Electric Vehicle Penetration Using Smart Switching and Emergency Uprating

Assessing the EV Hosting Capacity of Australian Urban and Rural MV-LV Networks

Electric Vehicle Development in China: A Charging Behavior and Power Sector Supply Balance Analysis

Dynamic modeling of distribution networks hosting electric vehicles interconnected via fast and slow chargers