Abstract:In order to achieve the target of carbon peak and carbon neutrality, electric vehicles (EVs) have increasingly received a prominent interest to electrify the transportation sector due to their advantages of mobility and flexibility on handling complicated transportation and power networks. However, it is still challenging to realize the significant potential of EVs towards an emerging low-carbon transition. Previous works have focused on vehicle-to-grid (V2G) technology that allows for an increased utilization of EVs to make arbitrage by the temporal differentials of electricity prices. Nevertheless, the economic potential of EVs flexibility may not be fully exploited lacking an appropriate business model. This paper addresses this challenge by developing a coupled power-transportation network for cooperative EVs to optimize the provision of multiple inter-dependent services, including charging service, demand management service, carbon intensity service, and balancing service. In order to unlock this value, the EVs operation problem has already been tackled using model-based optimization approaches, which may raise privacy issues since the requirement for global information and also can be time consuming due to the high variability of transportation and power networks. In this paper, we propose a model-free hierarchical and hybrid multi-agent reinforcement learning method to learn the routing and scheduling decisions of EVs in a coupled power-transportation network with the objective of optimizing multi-service provisions. To this end, EVs do not reply on any knowledge of the simulated environment and are capable of handling system uncertainties via the learning process. Extensive case studies based on a 15-bus radial power distribution network and a 9-node 12-edge transportation network are developed to show that the proposed method outperforms the conventional learning algorithms in terms of policy quality and convergence speed. Finally, the generalizability and scalability are also investigated for different environment circumstances and EV numbers.

Coordinated Unbalance Compensation and Harmonic Mitigation in the Secondary Distribution Network Through EVs Participation

Carbon-Aware Operation of Resilient Vertical Farms in Active Distribution Networks

Distribution Network Electric Vehicle Hosting Capacity Maximization: A Chargeable Region Optimization Model

Joint Energy-Computation Management for Electric Vehicles under Coordination of Power Distribution Networks and Computing Power Networks

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Robust Operation of Flexible Distribution Network with Large-Scale EV Charging Loads

Network-aware electric vehicle charging/discharging scheduling for grid load management in a hierarchical framework

Fully distributed planning method for coordinated distribution and urban transportation networks considering three-phase unbalance mitigation

Planning renewables in distribution system with electric vehicles to improve hosting capacity and energy losses: Two-stage stochastic optimization framework

A Two-Stage Multi-Agent EV Charging Coordination Scheme for Maximizing Grid Performance and Customer Satisfaction

Multi-objective coordinated EV charging strategy in distribution networks using an improved augmented epsilon-constrained method

Multi-objective optimization strategy for distribution network considering V2G-enabled electric vehicles in building integrated energy system

Distributed Energy Resource Deployment to Mitigate Adverse Effects of High EV Penetration in Unbalanced Distribution System by Analytical Sensitivity-Based Optimization

Optimal Scheduling for Increased Satisfaction of Both Electric Vehicle Users and Grid Fast-Charging Stations by SOR&KANO and MVO in PV-Connected Distribution Network

A Hierarchical Strategy for Multi-Objective Optimization of Distribution Network Considering DGs and V2G-Enabled EVs Integration

Leveraging Owners' Flexibility in Smart Charge/Discharge Scheduling of Electric Vehicles to Support Renewable Energy Integration

A Decentralized Bi-level Decomposition Method for Optimal Operation of Electric Vehicles in Coupled Urban Transportation and Power Distribution Systems

Bilevel optimal coordination of active distribution network and charging stations considering EV drivers' willingness

Unsplittable Load Balancing in a Network of Charging Stations Under QoS Guarantees

Active and Reactive Power Collaborative Optimization for Active Distribution Networks Considering Bi-Directional V2G Behavior

MPC-based Co-Optimization of an Integrated PV-EV-Hydrogen Station to Reduce Network Loss and Meet EV Charging Demand